-- Logs begin at Thu 2022-08-04 01:10:33 UTC, end at Thu 2022-08-04 02:54:12 UTC. -- Aug 04 02:27:56.553733 dv-cinder-740146-17-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 02:27:56.562321 dv-cinder-740146-17-smb devstack@n-api.service[104041]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 02:27:56 2022] *** Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: nodename: dv-cinder-740146-17-smb Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: machine: x86_64 Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: clock source: unix Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: pcre jit disabled Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: detected number of CPU cores: 4 Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: current working directory: / Aug 04 02:27:56.564290 dv-cinder-740146-17-smb devstack@n-api.service[104041]: detected binary path: /usr/bin/uwsgi-core Aug 04 02:27:56.565017 dv-cinder-740146-17-smb devstack@n-api.service[104041]: your processes number limit is 47680 Aug 04 02:27:56.565017 dv-cinder-740146-17-smb devstack@n-api.service[104041]: your memory page size is 4096 bytes Aug 04 02:27:56.565017 dv-cinder-740146-17-smb devstack@n-api.service[104041]: detected max file descriptor number: 2048 Aug 04 02:27:56.565017 dv-cinder-740146-17-smb devstack@n-api.service[104041]: lock engine: pthread robust mutexes Aug 04 02:27:56.565017 dv-cinder-740146-17-smb devstack@n-api.service[104041]: thunder lock: enabled Aug 04 02:27:56.565017 dv-cinder-740146-17-smb devstack@n-api.service[104041]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 02:27:56.565017 dv-cinder-740146-17-smb devstack@n-api.service[104041]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 02:27:56.605813 dv-cinder-740146-17-smb devstack@n-api.service[104041]: Python main interpreter initialized at 0x5592b476e9c0 Aug 04 02:27:56.605813 dv-cinder-740146-17-smb devstack@n-api.service[104041]: python threads support enabled Aug 04 02:27:56.605813 dv-cinder-740146-17-smb devstack@n-api.service[104041]: your server socket listen backlog is limited to 100 connections Aug 04 02:27:56.605813 dv-cinder-740146-17-smb devstack@n-api.service[104041]: your mercy for graceful operations on workers is 90 seconds Aug 04 02:27:56.606192 dv-cinder-740146-17-smb devstack@n-api.service[104041]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 02:27:56.606282 dv-cinder-740146-17-smb devstack@n-api.service[104041]: *** Operational MODE: preforking *** Aug 04 02:27:56.606472 dv-cinder-740146-17-smb devstack@n-api.service[104041]: *** uWSGI is running in multiple interpreter mode *** Aug 04 02:27:56.606472 dv-cinder-740146-17-smb devstack@n-api.service[104041]: spawned uWSGI master process (pid: 104041) Aug 04 02:27:56.606696 dv-cinder-740146-17-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 04 02:27:56.607589 dv-cinder-740146-17-smb devstack@n-api.service[104041]: spawned uWSGI worker 1 (pid: 104042, cores: 1) Aug 04 02:27:56.607589 dv-cinder-740146-17-smb devstack@n-api.service[104041]: spawned uWSGI worker 2 (pid: 104043, cores: 1) Aug 04 02:27:56.607757 dv-cinder-740146-17-smb devstack@n-api.service[104041]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 02:27:57.266705 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:27:57.271145 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:27:58.345792 dv-cinder-740146-17-smb devstack@n-api.service[104043]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:27:58.345792 dv-cinder-740146-17-smb devstack@n-api.service[104043]: from cryptography.utils import int_from_bytes Aug 04 02:27:58.346373 dv-cinder-740146-17-smb devstack@n-api.service[104043]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:27:58.346373 dv-cinder-740146-17-smb devstack@n-api.service[104043]: from cryptography.utils import int_from_bytes Aug 04 02:27:58.347768 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:27:58.347768 dv-cinder-740146-17-smb devstack@n-api.service[104042]: from cryptography.utils import int_from_bytes Aug 04 02:27:58.348209 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:27:58.348209 dv-cinder-740146-17-smb devstack@n-api.service[104042]: from cryptography.utils import int_from_bytes Aug 04 02:28:00.877881 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:28:00.878617 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:28:00.878724 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:28:00.879045 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:28:00.879303 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:28:00.879695 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.880085 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.880647 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.881053 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.881392 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.881711 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.882039 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.882368 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.882747 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.883017 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.883343 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.883673 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-smb {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.884000 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.884312 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.884626 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.885078 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.885397 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.885728 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.886038 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.886571 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.887005 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.887322 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.887641 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.887983 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.888301 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.888616 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.888942 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.889254 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.889581 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.889897 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.890301 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-smb {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.890649 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.890970 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.891290 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.891711 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.892029 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.892342 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.892666 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.893003 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.893324 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.893730 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.893988 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.894296 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.894641 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.894950 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.895264 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.895576 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.895901 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.896211 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.896518 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.896771 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.897083 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.897407 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.897734 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.898061 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.898314 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.898406 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:28:00.898822 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.898920 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:28:00.899007 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.899299 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.899525 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.899669 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:28:00.899837 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.900148 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.900264 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:28:00.900528 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.900710 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:28:00.900912 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.901315 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.901411 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.902758 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.902884 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.902968 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903144 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903239 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903392 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903476 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903576 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903667 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903747 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903830 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.903917 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904002 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904094 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904174 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904262 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904351 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904430 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904514 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904601 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904775 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.904874 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-smb {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.905096 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.905182 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.905409 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.905508 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.905734 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.905827 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.906058 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.906144 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.906358 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.906561 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.906787 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.907088 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.907185 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.907414 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.907614 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.907748 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.907920 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.908097 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.908224 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.908409 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.908529 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909324 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909429 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909513 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909603 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909684 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909775 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909862 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.909948 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.910034 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.910124 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.910410 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.910519 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.910613 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.910695 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.910781 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.911082 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.911195 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-smb {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.911388 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.911474 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.911695 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.911789 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.912002 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.912086 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.912309 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.912399 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.912618 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.912716 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.912929 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.913014 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.913244 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.913335 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.913552 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.913650 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.913872 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.913964 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.914194 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.914299 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.915644 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.915751 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.915834 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.915925 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.916007 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.916658 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.916768 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.916857 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.916937 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917016 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917093 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917227 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917227 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917389 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917477 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917623 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917750 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917872 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.917975 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.918071 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.918197 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.918288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.918536 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.918640 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.919729 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.919835 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.920088 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.920189 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.920324 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.920324 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.920501 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.924953 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925064 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925154 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925245 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925342 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925426 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925514 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925600 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925688 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925778 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.925916 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926000 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926090 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926178 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926259 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926350 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926714 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926802 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926878 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.926950 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927017 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927094 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927167 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927240 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927306 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927380 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927447 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927524 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927590 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927662 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927791 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927879 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.927958 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.928049 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.928135 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.928225 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.928306 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.928392 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.928392 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.928670 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.928754 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.928832 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.928916 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.929006 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.929099 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.929180 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.929264 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.929344 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.929422 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.929499 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.929641 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.929734 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.929814 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.929892 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.929969 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.930060 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.930145 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.930225 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.930303 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.930387 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.930473 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.930708 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.930799 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.930879 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.930879 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.931042 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.931120 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.931210 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.931290 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.931373 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.931453 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.931531 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.931609 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.931794 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.931927 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.932638 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.932746 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.933570 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.933725 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.933821 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.933903 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.933983 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.934069 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.934159 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.934249 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.934353 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.934596 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.934780 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.934930 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.935063 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.935240 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.935381 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.935557 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.935690 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.935872 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.936029 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.936182 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.936325 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.936469 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.936604 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.936750 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.936901 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.937045 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.937179 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.937313 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.937446 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.937615 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.937748 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.937920 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.938054 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.938237 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.938375 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.938563 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.938667 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.938868 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.938956 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.939280 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.939373 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.939599 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.939871 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.939959 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.940218 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.940450 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.940537 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.940794 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.940894 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.941097 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.941193 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.941402 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.941498 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.941735 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.941959 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.942047 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.942336 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.942572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.942676 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.942949 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.943056 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.943256 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.943345 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.943578 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.943666 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.943900 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.944122 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.944239 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.944549 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.944649 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.944864 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.945138 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.945235 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.945479 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.945653 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.945788 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.946105 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.946204 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.946418 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.946734 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.946823 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.947066 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.947313 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.947414 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.947704 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.947857 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.948029 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.948337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.948424 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.948646 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.948903 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.948990 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.949262 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.949446 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:28:00.949576 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.949890 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.950017 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.950207 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.950553 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.950643 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.950871 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.951163 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.951251 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.951512 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.951705 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.951845 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.952087 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.952166 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.952435 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.952512 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.952770 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.953727 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.953727 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.953913 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.953995 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954074 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954161 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954249 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954339 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954427 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954557 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954650 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954732 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954901 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.954985 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.955102 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.955226 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.955421 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.955521 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.955751 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.955859 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.956058 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.956247 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.956423 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.956572 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.956762 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.957035 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.957182 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.957360 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.957502 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.957674 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.957822 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.957989 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.958080 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.958301 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.958389 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.958668 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.958759 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.958980 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.959075 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960071 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960179 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960274 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960357 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960438 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960518 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960518 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960668 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960750 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960826 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.960893 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.961044 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.961181 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.961363 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.961498 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.961693 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.961813 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.962003 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.962128 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.962320 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.962450 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.962656 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.962788 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.963030 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.963175 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.963442 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.963627 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.963709 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965089 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965192 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965263 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965263 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965405 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965475 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965541 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965607 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965673 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965673 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965812 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965880 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.965946 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.966012 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.966086 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967202 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967299 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967299 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967460 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967539 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967617 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967685 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967751 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967816 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.967971 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.968970 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969065 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969136 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969210 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969278 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969344 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969419 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969488 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969554 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969631 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969700 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969766 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969872 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.969950 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.970041 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.970271 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.970358 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.970600 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.970713 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.970857 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.970944 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.971188 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.971275 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.971494 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.971591 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.971794 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.971889 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.972113 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.972200 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.972420 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.972508 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.972720 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.972806 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.973032 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.973132 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.973493 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.973596 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.973668 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.973880 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.973959 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.974193 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.974293 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.974565 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.974728 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.974878 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.975191 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.975284 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.975502 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.975699 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.975816 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.976019 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.976113 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.976345 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.976432 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.976660 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.976747 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.976973 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.977058 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.977308 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.977395 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.977623 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.977708 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.977930 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.978032 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.978273 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.979261 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.979417 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.979587 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.979675 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.979904 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.979993 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.980238 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.980325 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.980551 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.980636 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.980862 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.980937 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.981178 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.981490 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.981589 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.981827 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.981922 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.982138 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.982272 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.982438 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.982548 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.982772 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.982877 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.983074 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.983160 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.983374 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.983459 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.983693 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.983789 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984001 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984098 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984304 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984397 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984606 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984700 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984907 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.984993 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.985244 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.985330 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.985535 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.985646 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.985868 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.985981 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.986201 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.986329 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.986533 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.986661 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.986863 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.986960 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.987182 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.987498 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.987584 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.987817 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.988090 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.988200 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.988487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.988613 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.988802 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.988914 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.989114 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.989401 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.989626 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.989722 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.990047 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.990231 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.990372 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.990682 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.990774 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.991012 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.991089 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.991332 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.991415 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.991672 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.991920 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.992008 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.992321 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.992451 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.992635 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.992948 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.993033 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.993259 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.993494 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.993588 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.993875 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.994037 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.994242 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.995055 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.995260 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.995459 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.995774 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.995860 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.996085 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.996370 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.996459 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.996690 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.996938 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.997046 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.997302 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.997480 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.997616 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.997924 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.998017 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.998250 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.998548 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.998653 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.998886 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.999076 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.999195 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.999502 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.999596 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:00.999847 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.000138 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.000225 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001326 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001486 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001582 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001665 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001744 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001823 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001902 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.001980 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002067 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002154 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002235 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002314 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002392 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002534 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002648 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002848 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.002956 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.003167 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.003255 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.003499 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.003586 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.003834 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.003920 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.004144 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.004237 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.004452 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.004538 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.004775 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.004868 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.005084 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.005376 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.005475 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.005736 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.005822 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.006055 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.006141 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.006365 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.006452 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.006697 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.006783 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.007177 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.007299 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.007406 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.007494 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.007701 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.007787 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.007997 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.008073 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.008436 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.008527 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.008679 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.008826 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.008988 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.009133 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.009296 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.009436 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.009614 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.009747 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.010009 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.010128 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.010386 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.010573 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.010745 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.010892 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.011070 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.011210 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.011374 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.011524 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.011677 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.011834 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.012103 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.012199 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.012418 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.012512 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.012721 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.012817 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014067 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014196 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014293 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014383 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014466 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014578 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014578 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014739 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014819 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.014905 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.015940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016048 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016146 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016229 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016309 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016398 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016481 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016561 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.016719 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019085 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019185 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019271 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019352 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019432 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019529 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019610 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019678 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019744 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019818 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019900 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.019976 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020070 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020148 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020216 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020290 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020367 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020434 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020501 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020574 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020642 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020708 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020797 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.020868 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021111 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021193 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021270 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021339 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021415 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021482 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021549 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021615 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021615 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021749 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021816 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021889 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.021956 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022076 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022171 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022269 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022353 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022433 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022544 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022638 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022727 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.022817 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.023003 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.023091 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.023315 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.023401 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.023635 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.023730 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.023937 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.024023 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.024453 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.024556 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.024626 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.024788 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.024873 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.025101 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.025187 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.026019 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.026139 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.026511 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.026615 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.026927 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.027101 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.027239 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.027431 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.027555 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.027740 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.027869 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.028047 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.028183 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.028353 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.028494 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.028656 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.028807 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.028969 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.029123 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.029260 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.029438 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.029568 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.029869 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.029957 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.030278 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.030414 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.030690 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.030792 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.030996 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.031082 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.031372 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.031471 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.031683 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.031782 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.031993 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.032086 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.032335 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.032635 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.032759 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.032941 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.033033 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.033257 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.033346 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.033568 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.033667 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034082 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034193 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034193 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034330 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034517 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034650 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034825 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.034968 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.035127 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.035285 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.035426 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.035594 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.035730 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.035910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.036035 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.036226 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.036315 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.036546 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.036632 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.036864 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.036949 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.037901 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.038004 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.038081 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.038152 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.038220 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.038288 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.038288 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.038427 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039083 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039171 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039263 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039263 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039408 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039476 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039688 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.039804 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.040015 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.040199 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.040324 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.040508 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.040636 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.043190 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.043806 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.043806 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.043954 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044094 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044160 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044160 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044293 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044360 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044434 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044434 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044568 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044568 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044707 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044775 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044775 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.044893 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.045042 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.045114 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.045180 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.045452 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.045591 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.046182 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.046182 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.046352 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.046422 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.046647 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.046739 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.047030 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.047211 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.047351 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.047660 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.047754 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.047988 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.048256 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.048345 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.048617 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.048785 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.048947 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.049324 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.049443 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.049678 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.049844 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.049993 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.050319 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.050406 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.050688 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.050899 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.050988 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.051294 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.051695 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.051861 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.052178 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.052351 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.052484 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.052581 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.052810 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.052912 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.053119 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.053206 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.053431 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.053525 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.054627 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.054751 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.054751 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.054903 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.054983 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055070 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055150 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055238 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055238 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055391 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055479 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055560 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055640 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055727 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055852 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.055940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.056159 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.056252 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.056462 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.056550 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.056827 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.056916 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.057160 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.057338 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.057728 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.057828 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.058093 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.058188 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.058457 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.058627 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.058820 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.058907 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.059172 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.059280 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.059489 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.059677 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060026 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060184 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060264 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060344 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060438 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060550 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060685 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060841 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.060997 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.061136 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.061308 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.061455 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.061622 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.061799 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.061940 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.062074 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.062210 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.062352 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.062607 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.062700 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.062924 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.063023 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.063234 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.063329 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.063542 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.063628 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.063852 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.063960 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.064167 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.064254 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.064465 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.064560 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.064771 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.064857 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.065076 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.065162 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.065375 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.065476 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.065681 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.065767 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.065987 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.066073 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.066294 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.066382 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.066627 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.066730 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.066935 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.067020 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.067250 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.067345 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.067547 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.067642 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.067849 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.067936 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.068157 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.068252 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.068461 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.068548 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.068763 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.068850 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.069082 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.069177 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.069391 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.069493 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.069694 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.069804 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.070000 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.070129 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.070301 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.070426 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.070629 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.070734 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.070924 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.071022 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.071264 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.071351 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.071589 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.071784 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.071946 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.072103 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.072197 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.072290 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.072554 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.072721 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.072854 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.073124 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.073229 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.073454 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.073558 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.073751 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.073840 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.074074 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.074163 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.074395 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.074526 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.074736 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.074826 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.075053 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.075141 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.075367 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.075467 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.075667 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.075755 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.075975 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.076063 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.076294 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.076391 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.076605 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.076930 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.077018 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.077284 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.077381 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.077602 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.077697 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.077904 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.077993 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.078219 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.078326 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.078581 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.078673 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.078950 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.079038 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.079252 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.079403 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.079618 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.079723 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.079935 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.080050 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.080246 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.080346 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.080563 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.080652 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.080879 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.080984 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.081201 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.081303 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.081504 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.081600 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.081811 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.081908 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.082117 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.082205 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.082430 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.082531 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.082772 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.082876 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.083085 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.083179 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.083395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.083490 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.083696 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.083794 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.084015 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.084105 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.084333 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.084428 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.084641 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.084738 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.084957 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.085044 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.085275 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.085362 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.085594 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.085691 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.085960 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.086118 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.086278 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.086436 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.086627 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.086798 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.086929 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.087125 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.087214 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.087453 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.087552 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.087775 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.087863 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.088617 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.088761 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.088936 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.089079 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.089234 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.089331 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.089540 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.089644 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.089851 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.089998 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.090153 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.090269 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.090451 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.090583 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.090804 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.090895 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.091102 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.091204 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.091402 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.091500 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.091718 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.091807 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.092026 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.092113 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.092344 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.092558 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.092655 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.092912 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.093000 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.093232 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.093320 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.093542 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.093630 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.093839 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.093926 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.094140 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.094227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.094440 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.094552 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.094816 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.094925 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.095127 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.095215 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.095436 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.095533 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.095753 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.095840 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.096065 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.096167 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.096373 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.096461 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.096679 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.096767 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.096992 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.097088 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.097304 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.097400 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.097609 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.097698 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.097919 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.098016 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.098226 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.098315 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.098548 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.098651 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.098856 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.098955 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.099155 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.099244 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.099457 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.099553 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.099756 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.099864 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.100058 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.100149 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.100356 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.100491 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.100656 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.100745 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.100953 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.101041 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.101264 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.101352 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.101575 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.101696 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.101884 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.101984 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.102186 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.102282 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.102498 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.102609 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.102807 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.102904 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.103106 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.103210 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.103410 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.103549 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.104277 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.104384 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.104593 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.104726 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.105033 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.105131 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.105355 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.105445 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.105670 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.105776 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.105982 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.106069 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.106292 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.106381 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.106629 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.106737 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.106941 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.107029 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.107252 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.107341 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.107563 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.107807 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.107896 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.108149 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.108238 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.108461 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.108557 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.108772 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.108868 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.109125 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.109323 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.109457 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.109650 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.109740 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.109961 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.110095 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.110270 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.110361 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.110604 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.110697 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.110918 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.111006 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.111226 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.111326 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.111539 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.111634 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.111848 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.111948 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.112153 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.112250 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.112458 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.112547 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.112768 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.112855 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.113082 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.113179 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.113395 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.113484 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.113706 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.113794 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.114021 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.114110 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.114331 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.114425 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.114667 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.114757 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.114978 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.115067 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.115319 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.115413 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.115628 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.115728 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.115931 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.116020 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.116244 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.116339 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.116556 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.116652 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.116865 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.116959 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.117169 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.117263 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.117475 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.117577 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.117784 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.117871 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.118091 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.118178 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.118398 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.118524 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.118727 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.118819 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.119036 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.119124 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.119372 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.119604 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.119696 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.119927 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.120101 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.120254 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.120403 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.120580 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.120719 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.120900 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.121029 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.121225 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.121330 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.121552 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.121839 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.121927 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.122147 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.122298 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.122471 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.122582 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.122814 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.122904 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.123132 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.123239 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.123443 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.123546 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.123754 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.123843 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.124073 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.124169 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.124369 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.124462 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.124667 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.124756 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.124972 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.125069 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.125275 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.125370 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.125573 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.125662 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.125876 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.125971 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.126178 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.126265 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.126476 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.126589 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.126803 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.126892 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.127105 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.127193 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.127409 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.127629 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.127725 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128017 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128113 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128281 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128369 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128588 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128685 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128891 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.128979 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.129195 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.129292 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.129494 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.129634 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.129794 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.129882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.130095 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.130189 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.130395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.130514 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.130724 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.130812 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.131031 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.131121 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.131329 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.131418 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.131627 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.131714 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.131931 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.132028 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.132234 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.132335 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.132531 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.132685 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.132835 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.133016 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.133132 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.133331 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.133453 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.133657 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.133744 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.134014 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.134104 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.134322 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.134409 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.134651 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.134752 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.135018 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.135107 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.135334 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.135421 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.135668 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.135765 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.135976 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.136066 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.136284 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.136371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.136583 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.136679 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.136888 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.136975 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.137186 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.137274 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.137490 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.137591 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.137789 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.137876 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.138094 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.138189 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.138392 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.138507 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.138735 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.138824 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.139036 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.139124 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.139383 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.139512 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.139695 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.139782 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.140004 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.140104 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.140322 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.140410 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.140630 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.140728 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.140941 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.141066 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.141282 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.141373 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.141593 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.141680 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.141979 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.142119 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.142300 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.142444 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.142637 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.142788 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.142954 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.143118 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.143273 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.143445 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.143593 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.143746 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.143925 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.144047 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.144260 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.144348 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.144574 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.144663 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.144901 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.144997 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.145232 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.145328 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.145535 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.145621 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.145839 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.145928 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.146143 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.146231 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.146450 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.146579 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.146782 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.146872 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.147088 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.147175 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.147392 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.147479 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.147692 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:28:01.147781 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.147998 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.148303 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.148607 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.148920 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.149217 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.149549 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.149863 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.150172 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.151093 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.151428 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.151740 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.152049 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.152358 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.152661 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.152972 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.153297 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.153604 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.153908 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.154324 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.154658 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.154975 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.155291 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.155598 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.155915 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.156232 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.156540 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.156858 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.157162 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.157483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.157817 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.158142 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.158461 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.158792 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.159095 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.159394 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.159697 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.160011 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.160314 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.160613 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.160910 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.161221 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.161518 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.161818 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.162117 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.162415 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.162744 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.163041 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.163339 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.163636 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.163931 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.164226 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.164522 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.164821 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.165117 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.165415 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.165713 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.166033 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.166900 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.167232 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.167558 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.167868 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.168185 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.168491 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.168807 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.169114 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.169427 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.169741 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.170054 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.170355 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.170706 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.171016 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.171330 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.171638 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.171943 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.172250 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.172554 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.172876 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.173198 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.173501 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.173821 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.174134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.174456 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.174790 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.175096 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.175419 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.175725 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.176031 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.176335 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.176908 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.177215 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.177526 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.177832 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.178136 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.178449 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.178785 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.179108 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.179428 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.179735 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.180057 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.180379 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.180722 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.181034 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.181372 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.181713 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.182030 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.182356 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.182740 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:28:01.182983 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:28:01.304210 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO dbcounter [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Registered counter for database nova_api Aug 04 02:28:01.326966 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.333726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writer thread running {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:01.337155 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO dbcounter [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Registered counter for database nova_api Aug 04 02:28:01.358189 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_db.sqlalchemy.engines [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.364677 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writer thread running {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:01.392277 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.context [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d67d506-3efa-49a4-9082-a0012026440f(cell1) {{(pid=104042) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:28:01.396185 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:28:01.397808 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:28:01.398619 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:28:01.401336 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:28:01.403344 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO dbcounter [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Registered counter for database nova_cell0 Aug 04 02:28:01.408679 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO dbcounter [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Registered counter for database nova_cell1 Aug 04 02:28:01.415943 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.418916 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.422065 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.context [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d67d506-3efa-49a4-9082-a0012026440f(cell1) {{(pid=104043) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:28:01.423782 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writer thread running {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:01.426065 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_concurrency.lockutils [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:28:01.426911 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writer thread running {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:01.427943 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_concurrency.lockutils [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:28:01.428731 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_concurrency.lockutils [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:28:01.430749 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_concurrency.lockutils [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:28:01.432794 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO dbcounter [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Registered counter for database nova_cell0 Aug 04 02:28:01.438230 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO dbcounter [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Registered counter for database nova_cell1 Aug 04 02:28:01.445439 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_db.sqlalchemy.engines [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.447256 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_db.sqlalchemy.engines [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.453317 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writer thread running {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:01.458667 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writer thread running {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:01.572105 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO dbcounter [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Registered counter for database nova_cell0 Aug 04 02:28:01.579817 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.584063 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writer thread running {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:01.601545 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO dbcounter [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Registered counter for database nova_cell0 Aug 04 02:28:01.611158 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG oslo_db.sqlalchemy.engines [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:28:01.615415 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writer thread running {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:28:02.034015 dv-cinder-740146-17-smb devstack@n-api.service[104042]: WARNING keystonemiddleware.auth_token [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:28:02.042047 dv-cinder-740146-17-smb devstack@n-api.service[104042]: WARNING keystonemiddleware.auth_token [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:28:02.056082 dv-cinder-740146-17-smb devstack@n-api.service[104043]: WARNING keystonemiddleware.auth_token [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:28:02.063407 dv-cinder-740146-17-smb devstack@n-api.service[104043]: WARNING keystonemiddleware.auth_token [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:28:02.386811 dv-cinder-740146-17-smb devstack@n-api.service[104042]: WARNING keystonemiddleware.auth_token [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:28:02.392829 dv-cinder-740146-17-smb devstack@n-api.service[104042]: WARNING keystonemiddleware.auth_token [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:28:02.398096 dv-cinder-740146-17-smb devstack@n-api.service[104042]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5592b476e9c0 pid: 104042 (default app) Aug 04 02:28:02.400184 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:28:02.401497 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001834 Aug 04 02:28:02.401918 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Thu Aug 4 02:28:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:28:02.408421 dv-cinder-740146-17-smb devstack@n-api.service[104043]: WARNING keystonemiddleware.auth_token [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:28:02.414419 dv-cinder-740146-17-smb devstack@n-api.service[104043]: WARNING keystonemiddleware.auth_token [None req-57835e1e-15db-4954-bbc2-f2b941f1a77b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:28:02.420832 dv-cinder-740146-17-smb devstack@n-api.service[104043]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5592b476e9c0 pid: 104043 (default app) Aug 04 02:29:21.252966 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:21.253968 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 04 02:29:21.254374 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:21.266649 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writing DB stats nova_api:SELECT=3 {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:21.267775 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writing DB stats nova_cell0:SELECT=3 {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:21.268620 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writing DB stats nova_cell1:SELECT=3 {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:21.269887 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:22.145435 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-118cd64c-4dcb-41c5-bae1-f7c11f89b05a admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:22.178688 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-118cd64c-4dcb-41c5-bae1-f7c11f89b05a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917052 Aug 04 02:29:22.187144 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 4 02:29:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:24.411160 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:24.412364 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-f8b3f93b-c55a-48e7-b363-eb9fbeea5c20 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 04 02:29:24.417490 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:24.871375 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-bd32d3dc-2cc9-449f-be1c-c9a938487bd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "disk": 1}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:24.891105 dv-cinder-740146-17-smb devstack@n-api.service[104043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:29:24.891105 dv-cinder-740146-17-smb devstack@n-api.service[104043]: warnings.warn(msg) Aug 04 02:29:24.971397 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-bd32d3dc-2cc9-449f-be1c-c9a938487bd3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.552480 Aug 04 02:29:24.972021 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:29:24.985893 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_api:SELECT=3 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:24.987195 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_cell0:SELECT=3 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:24.988318 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_cell1:SELECT=3 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:24.989345 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:25.200546 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-1dcfb50d-f69e-4f64-bd89-6b3b4673fab9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:25.204872 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:29:25.204872 dv-cinder-740146-17-smb devstack@n-api.service[104042]: warnings.warn(msg) Aug 04 02:29:25.342953 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-1dcfb50d-f69e-4f64-bd89-6b3b4673fab9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.362214 Aug 04 02:29:25.343795 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 4 02:29:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:29:27.561794 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-bd32d3dc-2cc9-449f-be1c-c9a938487bd3 admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:27.562857 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-bd32d3dc-2cc9-449f-be1c-c9a938487bd3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 04 02:29:27.563414 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:28.223045 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-9d19ef2a-92c2-4beb-ab8b-fbad518947de admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "disk": 5, "name": "ds512M"}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:28.243988 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:29:28.243988 dv-cinder-740146-17-smb devstack@n-api.service[104042]: warnings.warn(msg) Aug 04 02:29:28.350628 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-9d19ef2a-92c2-4beb-ab8b-fbad518947de admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.780490 Aug 04 02:29:28.354887 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:29:28.363394 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-58c6ae98-43b0-4572-9121-a40deaa374ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:28.366353 dv-cinder-740146-17-smb devstack@n-api.service[104043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:29:28.366353 dv-cinder-740146-17-smb devstack@n-api.service[104043]: warnings.warn(msg) Aug 04 02:29:28.486097 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-58c6ae98-43b0-4572-9121-a40deaa374ed admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126381 Aug 04 02:29:28.499649 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 4 02:29:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:30.726860 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-9d19ef2a-92c2-4beb-ab8b-fbad518947de admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:30.727859 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-9d19ef2a-92c2-4beb-ab8b-fbad518947de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 04 02:29:30.728255 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:29:31.129223 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-df96b41d-6caa-43f4-a662-6099eb711a1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "disk": 10, "vcpus": 1}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:31.200829 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-df96b41d-6caa-43f4-a662-6099eb711a1c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466681 Aug 04 02:29:31.201319 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:29:31.213868 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-0a827e4b-a149-46d2-a6b4-d7bb14052d9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:31.284217 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-0a827e4b-a149-46d2-a6b4-d7bb14052d9e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074002 Aug 04 02:29:31.284781 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 4 02:29:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:33.476880 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-df96b41d-6caa-43f4-a662-6099eb711a1c admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:33.479007 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-df96b41d-6caa-43f4-a662-6099eb711a1c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 04 02:29:33.479007 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:33.889799 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-268573f3-b842-4baa-ae12-1fe409d5b840 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:33.978164 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-268573f3-b842-4baa-ae12-1fe409d5b840 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492991 Aug 04 02:29:33.979628 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:29:33.993249 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-50357a06-1d2f-4c47-8843-20005ff3f3f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:34.073850 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-50357a06-1d2f-4c47-8843-20005ff3f3f6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085693 Aug 04 02:29:34.082047 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 4 02:29:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:36.299281 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-268573f3-b842-4baa-ae12-1fe409d5b840 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:36.300317 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-268573f3-b842-4baa-ae12-1fe409d5b840 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 04 02:29:36.300974 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:36.733662 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-d91dbdea-12df-4cff-af5d-3424cad3680f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:36.849001 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-d91dbdea-12df-4cff-af5d-3424cad3680f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540866 Aug 04 02:29:36.849639 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:29:36.863381 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-c594c944-72ae-4105-bc31-73e28505f197 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:36.971836 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-c594c944-72ae-4105-bc31-73e28505f197 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111838 Aug 04 02:29:36.972768 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 4 02:29:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:29:39.210861 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-d91dbdea-12df-4cff-af5d-3424cad3680f admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:39.211869 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-d91dbdea-12df-4cff-af5d-3424cad3680f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 04 02:29:39.212295 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:39.647644 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-12fa0286-7c7d-4ecd-87fe-f7ab947ea118 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:39.674427 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-12fa0286-7c7d-4ecd-87fe-f7ab947ea118 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.455760 Aug 04 02:29:39.675023 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 4 02:29:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:29:42.176745 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-d91dbdea-12df-4cff-af5d-3424cad3680f admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:42.177811 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-d91dbdea-12df-4cff-af5d-3424cad3680f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Aug 04 02:29:42.178256 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:42.604348 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-8c4e6952-6d36-49f7-b963-47fd31f470a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 1, "name": "m1.tiny", "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:42.688246 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-8c4e6952-6d36-49f7-b963-47fd31f470a5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.503695 Aug 04 02:29:42.688956 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:29:42.701478 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-a7dfea51-ab49-4068-ab0d-fd5689841b38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:42.804810 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-a7dfea51-ab49-4068-ab0d-fd5689841b38 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106940 Aug 04 02:29:42.805262 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 4 02:29:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:45.007645 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-8c4e6952-6d36-49f7-b963-47fd31f470a5 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:45.008815 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-8c4e6952-6d36-49f7-b963-47fd31f470a5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Aug 04 02:29:45.009294 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:45.409923 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-a662d9b5-a9e4-4767-a208-4f5da610e789 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:45.486838 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-a662d9b5-a9e4-4767-a208-4f5da610e789 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471511 Aug 04 02:29:45.487394 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:29:45.500509 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-6f565908-c688-4d0b-a64b-f838a8bb741a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:45.575981 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-6f565908-c688-4d0b-a64b-f838a8bb741a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079053 Aug 04 02:29:45.576585 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 4 02:29:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:47.806718 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-a662d9b5-a9e4-4767-a208-4f5da610e789 admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:47.807736 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-a662d9b5-a9e4-4767-a208-4f5da610e789 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 04 02:29:47.808137 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:48.165788 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-701bf68f-e97f-4f6b-8ba7-c7dcf7070aca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "swap": 0}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:48.319469 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-701bf68f-e97f-4f6b-8ba7-c7dcf7070aca admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.505351 Aug 04 02:29:48.320068 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:29:48.332321 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-0487bc3e-540a-4ec7-b431-392b30773b0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:48.433090 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-0487bc3e-540a-4ec7-b431-392b30773b0b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104516 Aug 04 02:29:48.433673 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 4 02:29:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:29:50.667128 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-701bf68f-e97f-4f6b-8ba7-c7dcf7070aca admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:50.668826 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-701bf68f-e97f-4f6b-8ba7-c7dcf7070aca admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002278 Aug 04 02:29:50.669560 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:51.183300 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-53e211a3-d5e0-4481-96a4-13d3babefe38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:51.578472 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:51.585069 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-53e211a3-d5e0-4481-96a4-13d3babefe38 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.909486 Aug 04 02:29:51.585647 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:29:51.598693 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-eefeda11-8600-42fa-9b40-4adf95a4c533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:51.714827 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-eefeda11-8600-42fa-9b40-4adf95a4c533 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120365 Aug 04 02:29:51.715703 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 4 02:29:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:53.970629 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-53e211a3-d5e0-4481-96a4-13d3babefe38 admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:53.971652 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-53e211a3-d5e0-4481-96a4-13d3babefe38 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 04 02:29:53.972055 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:29:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:54.430925 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-cd4289a9-13a5-43cf-950d-72cd8a6166e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "disk": 160, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:54.509346 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-cd4289a9-13a5-43cf-950d-72cd8a6166e1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.531136 Aug 04 02:29:54.512010 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 4 02:29:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:29:54.526885 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-0a6bb52a-6250-45fa-8375-5e5a640ea4a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:54.616478 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-0a6bb52a-6250-45fa-8375-5e5a640ea4a1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095958 Aug 04 02:29:54.617067 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 4 02:29:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:30:14.715892 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-cd4289a9-13a5-43cf-950d-72cd8a6166e1 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:14.716904 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-cd4289a9-13a5-43cf-950d-72cd8a6166e1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 04 02:30:14.717303 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:15.112047 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-668632b9-a51c-4a55-bb98-8ecf22f1ab0d admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:15.130328 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-668632b9-a51c-4a55-bb98-8ecf22f1ab0d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406286 Aug 04 02:30:15.130933 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 4 02:30:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:30:16.206005 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-cd4289a9-13a5-43cf-950d-72cd8a6166e1 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:16.207243 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-cd4289a9-13a5-43cf-950d-72cd8a6166e1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 04 02:30:16.207642 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:30:16.731929 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-ec6ef320-d85b-4fad-b322-cb9ff067134b admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:16.737453 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.wsgi [None req-ec6ef320-d85b-4fad-b322-cb9ff067134b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-ec6ef320-d85b-4fad-b322-cb9ff067134b admin admin] Request method failure captured: Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Accept: application/json Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Accept-Encoding: gzip, deflate Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Connection: keep-alive Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Content-Length: 0 Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Host: 10.222.0.60 Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Openstack-Api-Version: compute 2.90 Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Openstack-System-Scope: None Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: User-Agent: python-novaclient Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Auth-Token: gAAAAABi6y84BoVvU2PEAKcQAyTFAokX6adB1k69-ZN7i0w_rH5aJQfE3XZMvGAPTA0wZilqVDxmJk2jfxMIIY6CH29W50H5ngRHfF5X_agJx4xuE2tE8bH_2JmINAvLSQ4Q8ZfCFLUsbRKr70rgxZ_VWIu7nSJmMlUqiQC2DtRpuZ8kyMbj3oo Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Domain-Id: None Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Domain-Name: None Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Identity-Status: Confirmed Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Is-Admin-Project: True Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Domain-Id: default Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Domain-Name: Default Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Name: admin Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Role: admin,reader,member Aug 04 02:30:16.740743 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Roles: admin,reader,member Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant: admin Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant-Name: admin Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User: admin Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Domain-Id: default Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Domain-Name: Default Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Id: 41158534548d42db82795c2a83978403 Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Name: admin Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: method: > Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: exception: Flavor 42 could not be found. Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: action_args: {'id': '42'} Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:30:16.742395 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:16.743483 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.744882 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-ec6ef320-d85b-4fad-b322-cb9ff067134b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:30:16.746189 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-ec6ef320-d85b-4fad-b322-cb9ff067134b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396544 Aug 04 02:30:16.746189 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 4 02:30:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:16.751769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-79ea5794-0bf1-4a9d-ada8-6745f74fe331 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:16.756067 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:16.775745 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-79ea5794-0bf1-4a9d-ada8-6745f74fe331 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027506 Aug 04 02:30:16.776315 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 4 02:30:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:30:16.786937 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-0225c9a3-d54c-432e-b0bf-40c40ddf015a admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:16.811237 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-0225c9a3-d54c-432e-b0bf-40c40ddf015a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028655 Aug 04 02:30:16.811703 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 4 02:30:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:30:16.821411 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-4ef960d1-81c1-42de-b485-e792063d8b0a admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:16.827418 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.wsgi [None req-4ef960d1-81c1-42de-b485-e792063d8b0a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-4ef960d1-81c1-42de-b485-e792063d8b0a admin admin] Request method failure captured: Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Accept: application/json Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Accept-Encoding: gzip, deflate Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Connection: keep-alive Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Content-Length: 0 Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Host: 10.222.0.60 Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Openstack-Api-Version: compute 2.90 Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Openstack-System-Scope: None Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: User-Agent: python-novaclient Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Auth-Token: gAAAAABi6y84BoVvU2PEAKcQAyTFAokX6adB1k69-ZN7i0w_rH5aJQfE3XZMvGAPTA0wZilqVDxmJk2jfxMIIY6CH29W50H5ngRHfF5X_agJx4xuE2tE8bH_2JmINAvLSQ4Q8ZfCFLUsbRKr70rgxZ_VWIu7nSJmMlUqiQC2DtRpuZ8kyMbj3oo Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Domain-Id: None Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Domain-Name: None Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Identity-Status: Confirmed Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Is-Admin-Project: True Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Domain-Id: default Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Domain-Name: Default Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Name: admin Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Role: admin,reader,member Aug 04 02:30:16.830726 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Roles: admin,reader,member Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant: admin Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant-Name: admin Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User: admin Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Domain-Id: default Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Domain-Name: Default Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Id: 41158534548d42db82795c2a83978403 Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Name: admin Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: method: > Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: exception: Flavor 42 could not be found. Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: action_args: {'id': '42'} Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:30:16.839027 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:16.839858 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:16.840940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-4ef960d1-81c1-42de-b485-e792063d8b0a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:30:16.842019 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-4ef960d1-81c1-42de-b485-e792063d8b0a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015181 Aug 04 02:30:16.842019 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 4 02:30:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:17.814707 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-0225c9a3-d54c-432e-b0bf-40c40ddf015a admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:17.815711 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-0225c9a3-d54c-432e-b0bf-40c40ddf015a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 04 02:30:17.816865 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:18.363821 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-d507d332-2071-48ec-ae11-aee528156f1b admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:18.369324 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.wsgi [None req-d507d332-2071-48ec-ae11-aee528156f1b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-d507d332-2071-48ec-ae11-aee528156f1b admin admin] Request method failure captured: Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Accept: application/json Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Accept-Encoding: gzip, deflate Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Connection: keep-alive Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Content-Length: 0 Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Host: 10.222.0.60 Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Openstack-Api-Version: compute 2.90 Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Openstack-System-Scope: None Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: User-Agent: python-novaclient Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Auth-Token: gAAAAABi6y857qTj3AeYD1VKvwSdacglO0asxqo-KRTcaf1ecRs5ka8JcwsuJ9sPu82l7gsCEXXhqWmuvhcy3W3J6Wdm_lPHGLxM9B9FcrlaS95uAqk-JLqsxdv-pN_ZE5-rPwn4pp9EckTKhoJjMLG40pX0KFcqhba2Cp7buxD4Dl8o6Plplk0 Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Domain-Id: None Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Domain-Name: None Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Identity-Status: Confirmed Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Is-Admin-Project: True Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Domain-Id: default Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Domain-Name: Default Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Name: admin Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Role: admin,reader,member Aug 04 02:30:18.370910 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Roles: admin,reader,member Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant: admin Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant-Name: admin Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User: admin Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Domain-Id: default Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Domain-Name: Default Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Id: 41158534548d42db82795c2a83978403 Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Name: admin Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: method: > Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: exception: Flavor 84 could not be found. Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: action_args: {'id': '84'} Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:30:18.372499 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:18.373769 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.375288 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-d507d332-2071-48ec-ae11-aee528156f1b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:30:18.376533 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-d507d332-2071-48ec-ae11-aee528156f1b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.412156 Aug 04 02:30:18.376533 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 4 02:30:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:18.382610 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-2fea413d-6fa3-4351-b122-7c4b6f697328 admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:18.398397 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-2fea413d-6fa3-4351-b122-7c4b6f697328 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019710 Aug 04 02:30:18.398941 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 4 02:30:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:30:18.408433 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-3da8135d-124d-49b9-8e56-45de6516ca5d admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:18.424175 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-3da8135d-124d-49b9-8e56-45de6516ca5d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019337 Aug 04 02:30:18.424701 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 4 02:30:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:30:18.433802 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-0e45d37c-c909-447f-8bb2-4c5df29b54eb admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:18.439003 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.wsgi [None req-0e45d37c-c909-447f-8bb2-4c5df29b54eb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-0e45d37c-c909-447f-8bb2-4c5df29b54eb admin admin] Request method failure captured: Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Accept: application/json Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Accept-Encoding: gzip, deflate Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Connection: keep-alive Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Content-Length: 0 Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Host: 10.222.0.60 Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Openstack-Api-Version: compute 2.90 Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Openstack-System-Scope: None Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: User-Agent: python-novaclient Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Auth-Token: gAAAAABi6y857qTj3AeYD1VKvwSdacglO0asxqo-KRTcaf1ecRs5ka8JcwsuJ9sPu82l7gsCEXXhqWmuvhcy3W3J6Wdm_lPHGLxM9B9FcrlaS95uAqk-JLqsxdv-pN_ZE5-rPwn4pp9EckTKhoJjMLG40pX0KFcqhba2Cp7buxD4Dl8o6Plplk0 Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Domain-Id: None Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Domain-Name: None Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Identity-Status: Confirmed Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Is-Admin-Project: True Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Domain-Id: default Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Domain-Name: Default Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Name: admin Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Role: admin,reader,member Aug 04 02:30:18.440487 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Roles: admin,reader,member Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant: admin Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant-Name: admin Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User: admin Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Domain-Id: default Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Domain-Name: Default Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Id: 41158534548d42db82795c2a83978403 Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Name: admin Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: method: > Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: exception: Flavor 84 could not be found. Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: action_args: {'id': '84'} Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:30:18.442023 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:18.451482 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:18.452572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-0e45d37c-c909-447f-8bb2-4c5df29b54eb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:30:18.453648 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-0e45d37c-c909-447f-8bb2-4c5df29b54eb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011857 Aug 04 02:30:18.453648 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 4 02:30:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 02:30:19.426713 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-3da8135d-124d-49b9-8e56-45de6516ca5d admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:19.427954 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-3da8135d-124d-49b9-8e56-45de6516ca5d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 04 02:30:19.428433 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:19.953261 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-5446e402-3375-4e4d-93ef-fedbb358c688 admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:19.959213 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.wsgi [None req-5446e402-3375-4e4d-93ef-fedbb358c688 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-5446e402-3375-4e4d-93ef-fedbb358c688 admin admin] Request method failure captured: Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Accept: application/json Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Accept-Encoding: gzip, deflate Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Connection: keep-alive Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Content-Length: 0 Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Host: 10.222.0.60 Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Openstack-Api-Version: compute 2.90 Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Openstack-System-Scope: None Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: User-Agent: python-novaclient Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Auth-Token: gAAAAABi6y870buJ9cvGATw_dPjXnovkaw995AQtOlRF7mpZPG_9vm1BsWDbAq8p5E7htldolnATgwcVqACgLMQEMZLEqc70WtF0O3FE9un4Mg7SdwXDtGtniCkkE83ym9-e3bNaKgt6Cukd0jzSnr641I-Wajl87ChSSdkrJCuhK9R1lLK5IAU Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Domain-Id: None Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Domain-Name: None Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Identity-Status: Confirmed Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Is-Admin-Project: True Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Domain-Id: default Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Domain-Name: Default Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Project-Name: admin Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Role: admin,reader,member Aug 04 02:30:19.960779 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Roles: admin,reader,member Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant: admin Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-Tenant-Name: admin Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User: admin Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Domain-Id: default Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Domain-Name: Default Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Id: 41158534548d42db82795c2a83978403 Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: X-User-Name: admin Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: method: > Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: exception: Flavor 451 could not be found. Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: action_args: {'id': '451'} Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:30:19.962134 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:19.963196 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: ERROR nova.api.openstack.wsgi Aug 04 02:30:19.964513 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-5446e402-3375-4e4d-93ef-fedbb358c688 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:30:19.965643 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-5446e402-3375-4e4d-93ef-fedbb358c688 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393819 Aug 04 02:30:19.965643 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 4 02:30:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:19.975032 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-a6bb903b-8705-48b1-b998-3dc886c2d1cc admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:19.992202 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-a6bb903b-8705-48b1-b998-3dc886c2d1cc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023753 Aug 04 02:30:19.992784 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 4 02:30:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:30:20.002672 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:20.018622 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019673 Aug 04 02:30:20.019352 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 4 02:30:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:30:20.028716 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-f351bf95-82cf-453d-a257-d702db8dc2d3 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:20.034113 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.wsgi [None req-f351bf95-82cf-453d-a257-d702db8dc2d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-f351bf95-82cf-453d-a257-d702db8dc2d3 admin admin] Request method failure captured: Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Accept: application/json Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Accept-Encoding: gzip, deflate Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Connection: keep-alive Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Content-Length: 0 Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Host: 10.222.0.60 Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Openstack-Api-Version: compute 2.90 Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Openstack-System-Scope: None Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: User-Agent: python-novaclient Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Auth-Token: gAAAAABi6y870buJ9cvGATw_dPjXnovkaw995AQtOlRF7mpZPG_9vm1BsWDbAq8p5E7htldolnATgwcVqACgLMQEMZLEqc70WtF0O3FE9un4Mg7SdwXDtGtniCkkE83ym9-e3bNaKgt6Cukd0jzSnr641I-Wajl87ChSSdkrJCuhK9R1lLK5IAU Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Domain-Id: None Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Domain-Name: None Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Identity-Status: Confirmed Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Is-Admin-Project: True Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Domain-Id: default Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Domain-Name: Default Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Project-Name: admin Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Role: admin,reader,member Aug 04 02:30:20.036011 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Roles: admin,reader,member Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aa60e5b58354576a0cb898fee2dc9ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant: admin Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant-Id: 7aa60e5b58354576a0cb898fee2dc9ca Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-Tenant-Name: admin Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User: admin Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Domain-Id: default Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Domain-Name: Default Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Id: 41158534548d42db82795c2a83978403 Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: X-User-Name: admin Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: method: > Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: exception: Flavor 451 could not be found. Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: action_args: {'id': '451'} Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:30:20.037337 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:20.038227 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: ERROR nova.api.openstack.wsgi Aug 04 02:30:20.039371 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-f351bf95-82cf-453d-a257-d702db8dc2d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:30:20.040608 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-f351bf95-82cf-453d-a257-d702db8dc2d3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012259 Aug 04 02:30:20.040608 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 4 02:30:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:21.004349 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:21.005380 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Aug 04 02:30:21.005770 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:21.534616 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-578fe7ed-289e-4c2d-be3b-b102f2eed2e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:30:21.621336 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-578fe7ed-289e-4c2d-be3b-b102f2eed2e6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.475812 Aug 04 02:30:21.621940 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 4 02:30:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:30:22.600665 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:22.601673 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 04 02:30:22.602065 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:23.139649 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-aaaa5eef-63e5-4604-80e5-1220bb13d1f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:30:23.194280 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-aaaa5eef-63e5-4604-80e5-1220bb13d1f6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.452107 Aug 04 02:30:23.194862 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 4 02:30:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:30:24.168282 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:24.169293 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 04 02:30:24.169686 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:24.695099 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-9580cf0c-8d1e-4747-a57c-c076d96846f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:30:24.806240 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-9580cf0c-8d1e-4747-a57c-c076d96846f3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.497905 Aug 04 02:30:24.806813 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 4 02:30:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:30:25.788731 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:25.789852 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 04 02:30:25.790295 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:26.321216 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-4a251d07-6341-4981-a2a1-ed9f27e78ca6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:30:26.397100 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-4a251d07-6341-4981-a2a1-ed9f27e78ca6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.464599 Aug 04 02:30:26.397650 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 4 02:30:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:30:27.371732 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:27.372750 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 04 02:30:27.373153 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:27.904044 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-20e44578-253e-46d0-9495-0b155e6aaafd admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:30:27.925725 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-20e44578-253e-46d0-9495-0b155e6aaafd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412632 Aug 04 02:30:27.925725 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Thu Aug 4 02:30:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:31:19.660853 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:19.661864 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-582181ec-a100-47d0-b20c-f4f594f2a0fd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 04 02:31:19.662262 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 4 02:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:31:19.673677 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:20.056474 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-0e1059d2-ae70-4086-ab70-335b6347469f admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:20.077251 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-0e1059d2-ae70-4086-ab70-335b6347469f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409059 Aug 04 02:31:20.078277 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 4 02:31:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:31:20.099823 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG dbcounter [-] [104043] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:20.103645 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-ae72aeb6-2322-46a9-97fb-0ed159f9abe5 admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:20.111281 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-ae72aeb6-2322-46a9-97fb-0ed159f9abe5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013011 Aug 04 02:31:20.111789 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Thu Aug 4 02:31:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:20.123374 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-a7f18927-58cf-4539-b71c-e96757d6f5dc admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:20.131492 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-a7f18927-58cf-4539-b71c-e96757d6f5dc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011750 Aug 04 02:31:20.132007 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Thu Aug 4 02:31:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:20.143958 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:20.151732 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012200 Aug 04 02:31:20.152233 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Thu Aug 4 02:31:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:31:20.163341 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-f4b251d6-a9c3-4262-b291-9e847d193f44 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:20.171041 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-f4b251d6-a9c3-4262-b291-9e847d193f44 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011186 Aug 04 02:31:20.171584 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Thu Aug 4 02:31:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:34:29.125334 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:29.126341 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 04 02:34:29.126768 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:34:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:34:29.267313 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_api:SELECT=6 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:29.432252 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-54f4ebfa-9fdf-4d46-becb-7fe0d0a13082 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:29.434719 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:34:29.434719 dv-cinder-740146-17-smb devstack@n-api.service[104042]: warnings.warn(msg) Aug 04 02:34:29.435951 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-54f4ebfa-9fdf-4d46-becb-7fe0d0a13082 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:29.436399 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-54f4ebfa-9fdf-4d46-becb-7fe0d0a13082 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:29.437201 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-54f4ebfa-9fdf-4d46-becb-7fe0d0a13082 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:29.437630 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-54f4ebfa-9fdf-4d46-becb-7fe0d0a13082 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:29.472459 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-54f4ebfa-9fdf-4d46-becb-7fe0d0a13082 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 788 microversion: 2.90 time: 0.206569 Aug 04 02:34:29.473019 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 4 02:34:29 2022] GET /compute/v2.1/os-services => generated 788 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:34:30.315564 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:30.316574 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 04 02:34:30.316961 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:34:30.508403 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-4aa0326e-5fc6-4a8e-80e2-3f9d7f2529d0 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:30.510805 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:34:30.510805 dv-cinder-740146-17-smb devstack@n-api.service[104042]: warnings.warn(msg) Aug 04 02:34:30.512002 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-4aa0326e-5fc6-4a8e-80e2-3f9d7f2529d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:30.512481 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-4aa0326e-5fc6-4a8e-80e2-3f9d7f2529d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:30.513272 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-4aa0326e-5fc6-4a8e-80e2-3f9d7f2529d0 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:30.513701 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-4aa0326e-5fc6-4a8e-80e2-3f9d7f2529d0 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:30.532836 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-4aa0326e-5fc6-4a8e-80e2-3f9d7f2529d0 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 788 microversion: 2.90 time: 0.077591 Aug 04 02:34:30.533380 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 4 02:34:30 2022] GET /compute/v2.1/os-services => generated 788 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:34:41.795953 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:41.796965 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 04 02:34:41.797353 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:34:41.941370 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_cell0:SELECT=4 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:41.942144 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_cell1:SELECT=4 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:41.942790 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG dbcounter [-] [104042] Writing DB stats nova_api:SELECT=8 {{(pid=104042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:41.992640 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-3099301d-4dbb-44b4-a8c8-34456fa6a822 admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:41.995075 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:34:41.995075 dv-cinder-740146-17-smb devstack@n-api.service[104042]: warnings.warn(msg) Aug 04 02:34:41.996281 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-3099301d-4dbb-44b4-a8c8-34456fa6a822 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:41.996724 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-3099301d-4dbb-44b4-a8c8-34456fa6a822 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:41.997510 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-3099301d-4dbb-44b4-a8c8-34456fa6a822 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:41.997943 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-3099301d-4dbb-44b4-a8c8-34456fa6a822 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:42.024053 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-3099301d-4dbb-44b4-a8c8-34456fa6a822 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1032 microversion: 2.90 time: 0.087062 Aug 04 02:34:42.024596 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 4 02:34:41 2022] GET /compute/v2.1/os-services => generated 1032 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:34:42.854563 dv-cinder-740146-17-smb devstack@n-api.service[104043]: DEBUG nova.api.openstack.wsgi [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] Calling method '>' {{(pid=104043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:42.855572 dv-cinder-740146-17-smb devstack@n-api.service[104043]: INFO nova.api.openstack.requestlog [None req-30e5cf39-4d14-49bf-95a0-7c2a40da70fe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 04 02:34:42.855976 dv-cinder-740146-17-smb devstack@n-api.service[104043]: [pid: 104043|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 4 02:34:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:34:43.045999 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG nova.api.openstack.wsgi [None req-bcdae692-0b96-4ac6-a816-c58a011b578f admin admin] Calling method '>' {{(pid=104042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:34:43.048510 dv-cinder-740146-17-smb devstack@n-api.service[104042]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:34:43.048510 dv-cinder-740146-17-smb devstack@n-api.service[104042]: warnings.warn(msg) Aug 04 02:34:43.049704 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-bcdae692-0b96-4ac6-a816-c58a011b578f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:43.050146 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-bcdae692-0b96-4ac6-a816-c58a011b578f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:43.050969 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-bcdae692-0b96-4ac6-a816-c58a011b578f admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:34:43.051400 dv-cinder-740146-17-smb devstack@n-api.service[104042]: DEBUG oslo_concurrency.lockutils [None req-bcdae692-0b96-4ac6-a816-c58a011b578f admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:34:43.073704 dv-cinder-740146-17-smb devstack@n-api.service[104042]: INFO nova.api.openstack.requestlog [None req-bcdae692-0b96-4ac6-a816-c58a011b578f admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1032 microversion: 2.90 time: 0.079461 Aug 04 02:34:43.074210 dv-cinder-740146-17-smb devstack@n-api.service[104042]: [pid: 104042|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 4 02:34:42 2022] GET /compute/v2.1/os-services => generated 1032 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:35:44.644567 dv-cinder-740146-17-smb devstack@n-api.service[104041]: Thu Aug 4 02:35:44 2022 - graceful shutdown triggered... Aug 04 02:35:44.645063 dv-cinder-740146-17-smb devstack@n-api.service[104042]: Gracefully killing worker 1 (pid: 104042)... Aug 04 02:35:44.644674 dv-cinder-740146-17-smb systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 02:35:44.645873 dv-cinder-740146-17-smb devstack@n-api.service[104043]: Gracefully killing worker 2 (pid: 104043)... Aug 04 02:35:45.645717 dv-cinder-740146-17-smb devstack@n-api.service[104041]: worker 1 buried after 1 seconds Aug 04 02:35:45.646270 dv-cinder-740146-17-smb devstack@n-api.service[104041]: worker 2 buried after 1 seconds Aug 04 02:35:45.646270 dv-cinder-740146-17-smb devstack@n-api.service[104041]: goodbye to uWSGI. Aug 04 02:35:45.647317 dv-cinder-740146-17-smb systemd[1]: devstack@n-api.service: Succeeded. Aug 04 02:35:45.647856 dv-cinder-740146-17-smb systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 02:35:45.650711 dv-cinder-740146-17-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 02:35:45.661897 dv-cinder-740146-17-smb devstack@n-api.service[124984]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 02:35:45 2022] *** Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: nodename: dv-cinder-740146-17-smb Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: machine: x86_64 Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: clock source: unix Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: pcre jit disabled Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: detected number of CPU cores: 4 Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: current working directory: / Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: detected binary path: /usr/bin/uwsgi-core Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: your processes number limit is 47680 Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: your memory page size is 4096 bytes Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: detected max file descriptor number: 2048 Aug 04 02:35:45.664010 dv-cinder-740146-17-smb devstack@n-api.service[124984]: lock engine: pthread robust mutexes Aug 04 02:35:45.664886 dv-cinder-740146-17-smb devstack@n-api.service[124984]: thunder lock: enabled Aug 04 02:35:45.664886 dv-cinder-740146-17-smb devstack@n-api.service[124984]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 02:35:45.664886 dv-cinder-740146-17-smb devstack@n-api.service[124984]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 02:35:45.704540 dv-cinder-740146-17-smb devstack@n-api.service[124984]: Python main interpreter initialized at 0x5604887ba9c0 Aug 04 02:35:45.704540 dv-cinder-740146-17-smb devstack@n-api.service[124984]: python threads support enabled Aug 04 02:35:45.704540 dv-cinder-740146-17-smb devstack@n-api.service[124984]: your server socket listen backlog is limited to 100 connections Aug 04 02:35:45.704540 dv-cinder-740146-17-smb devstack@n-api.service[124984]: your mercy for graceful operations on workers is 90 seconds Aug 04 02:35:45.705009 dv-cinder-740146-17-smb devstack@n-api.service[124984]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 02:35:45.705009 dv-cinder-740146-17-smb devstack@n-api.service[124984]: *** Operational MODE: preforking *** Aug 04 02:35:45.705255 dv-cinder-740146-17-smb devstack@n-api.service[124984]: *** uWSGI is running in multiple interpreter mode *** Aug 04 02:35:45.705255 dv-cinder-740146-17-smb devstack@n-api.service[124984]: spawned uWSGI master process (pid: 124984) Aug 04 02:35:45.705464 dv-cinder-740146-17-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 04 02:35:45.710337 dv-cinder-740146-17-smb devstack@n-api.service[124984]: spawned uWSGI worker 1 (pid: 124996, cores: 1) Aug 04 02:35:45.710337 dv-cinder-740146-17-smb devstack@n-api.service[124984]: spawned uWSGI worker 2 (pid: 124997, cores: 1) Aug 04 02:35:45.710337 dv-cinder-740146-17-smb devstack@n-api.service[124984]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 02:35:46.372116 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:35:46.394208 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:35:47.536399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:35:47.536399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: from cryptography.utils import int_from_bytes Aug 04 02:35:47.537246 dv-cinder-740146-17-smb devstack@n-api.service[124996]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:35:47.537246 dv-cinder-740146-17-smb devstack@n-api.service[124996]: from cryptography.utils import int_from_bytes Aug 04 02:35:47.572988 dv-cinder-740146-17-smb devstack@n-api.service[124997]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:35:47.572988 dv-cinder-740146-17-smb devstack@n-api.service[124997]: from cryptography.utils import int_from_bytes Aug 04 02:35:47.573562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:35:47.573562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: from cryptography.utils import int_from_bytes Aug 04 02:35:49.867749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:35:49.868318 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:35:49.868611 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:35:49.868900 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:35:49.869160 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:35:49.869551 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.869882 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.870214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.870563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.870898 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.871212 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.871550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.871868 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.872196 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.872460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.872779 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.873107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-smb {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.873728 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.873841 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.874102 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.874409 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.874732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.875058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.875367 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.875865 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.877261 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.877261 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.877261 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.877656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.877928 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.878209 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.878573 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.878901 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.879221 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.879538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.879941 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-smb {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.880269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.880589 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.880904 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.881321 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.881638 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.881972 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.882281 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.882634 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.882950 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.883273 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.883595 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.883919 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.884265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.884548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.884862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.885176 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.885499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.885806 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.886114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.887218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.887218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.887218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.887663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.887663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.887988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.888164 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.888423 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.888742 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.889112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.889431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.889743 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.890056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.890367 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.890702 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.891013 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.891323 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.891646 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.891968 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.892302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.892609 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.892930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.893361 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.893618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.893932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.894276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.894621 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.894939 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.895278 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.895577 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.895888 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.896197 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.896507 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.896827 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.897163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.897472 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.897845 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.898022 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.898524 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.898706 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.899041 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.899691 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.899691 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.899925 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.900246 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.900554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.900864 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.901175 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.901485 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.901794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.902104 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.902412 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.902751 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.903078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.903400 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.903710 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.904020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.904328 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.904636 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.904972 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.905265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.905594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.906155 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.906462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.906790 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.907109 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.907420 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.907729 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.908051 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.908358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.909191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.909511 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.909887 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.910229 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.910564 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.910878 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.911188 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.911497 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.911804 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.912114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.912418 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.912744 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.913066 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.913381 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.913689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.913996 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.914318 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.914688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.915027 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.915375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.915695 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.916028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.916365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.916693 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.917011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.917332 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.917663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.917981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.918296 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.918636 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.918964 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.919287 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.919622 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.919947 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.920268 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.920591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.920907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.921230 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.921563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.921887 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.922199 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.922563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.922912 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.923226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.923553 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.923882 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.924199 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.925282 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.925687 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.925989 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.926326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.926837 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.927168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.927502 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.932867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.933383 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.933383 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.933383 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.933636 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.933986 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.934292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.934679 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.935011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.935327 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.935684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.936011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.936112 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:35:49.936543 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:35:49.936664 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.936664 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.936828 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:35:49.936999 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.937174 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:35:49.937391 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.937545 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:35:49.937673 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.937767 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.938077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.938174 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.938368 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.938472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.938703 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.939014 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.939113 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.939200 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.939371 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.939463 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.939775 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.939906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.940573 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.940665 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.940912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.941020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.941144 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.941311 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.941463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.941633 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.941794 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-smb {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.941949 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.942121 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.942288 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.942433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.942648 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.942778 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.942960 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.943103 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.943287 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.943414 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.943617 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.943739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.943938 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.944051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.944241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.944542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.944664 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.944852 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.944944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.945164 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.945263 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.945472 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.945587 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.945786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.945918 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.946092 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.946192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.946400 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.946522 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.946730 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.946836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.947038 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.947139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.947346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.947446 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.947666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.947757 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.947978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.948078 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-smb {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.948286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.948379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.948594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.948686 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.948901 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.948994 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.949248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.949385 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.949557 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.949707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.949906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.950008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.950245 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.950337 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.950590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.950714 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.950927 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.951029 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.951235 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.951335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.951554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.951654 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.951867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.951966 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.952186 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.952278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.952501 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.952607 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.952810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.952902 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.953123 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.953215 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.953436 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.953540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.953743 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.953842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.954054 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.954174 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.954307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.954401 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.954643 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.954749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.954976 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.955069 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.955299 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.955398 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.956229 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.956357 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.956449 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.956738 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.956854 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.957016 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.957147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.957304 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.957431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.957617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.957760 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.957931 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.958077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.958243 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.958397 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.958584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.958741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.958867 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.959059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.959225 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.959378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.959512 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.959700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.959834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.960024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.960116 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.960340 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.960441 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.960694 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.960799 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.961007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.961108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.961331 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.961423 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.961690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.961778 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.961977 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.962061 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.962290 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.962381 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.962651 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.962744 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.962974 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.963056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.963289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.963387 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.963605 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.963695 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.963923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.964006 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.964236 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.964339 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.964544 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.964625 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.964853 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.964934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.966108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.966330 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.966429 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.966539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.967691 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.967885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.967885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.968152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.968251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.968346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.968346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.968511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.968596 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.968690 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.969413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.969516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.969612 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.969707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.969809 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.969904 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.969999 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.970093 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.970240 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.970339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.970339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.970575 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.970673 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.970760 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.970845 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.970929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.971022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.971200 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.971462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.971563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.971649 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.971741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.971836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.971929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.972021 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.972113 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.972205 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.972300 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.972300 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.972462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.972554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.972749 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.972851 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.972947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.973040 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.973133 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.973220 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.973312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.973398 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.973540 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.973644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.973867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.973973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.974183 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.974335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.974521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.974632 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.974840 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.974952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.975153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.975478 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.975570 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.975797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.975897 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.976109 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.976251 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.976422 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.976523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.976739 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.976847 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.977044 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.977135 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.977356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.977455 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.977692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.977837 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.977990 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.978082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.978299 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.978399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.978633 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.978745 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.978944 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.979037 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.979254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.979354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.979566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.979669 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.979877 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.980152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.980247 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.980479 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.980582 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.980802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.980894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.981127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.981276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.981445 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.981553 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.981756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.981850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.982067 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.982166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.982390 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:35:49.982526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.982761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.982868 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.983100 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.983203 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.983431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.983530 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.983743 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.983837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.984052 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.984207 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.984369 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.984470 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.984681 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.984775 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.984994 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.985089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.985303 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.985402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.985618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.985712 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.985925 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.986028 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.986293 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.986406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.986558 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.986658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.987389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.987654 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.987761 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.987953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.988094 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.988293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.988415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.988619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.988713 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.988948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.989042 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.989277 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.989379 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.989595 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.989689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.989922 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.990015 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.990236 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.990328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.990600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.990742 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.990909 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.991031 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.991250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.991398 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.991584 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.991679 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.991900 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.992006 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.992225 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.992317 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.992534 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.992680 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.992857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.992959 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.993177 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.993280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.993481 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.993580 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.993787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.993881 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.994099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.994193 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.994411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.994555 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.994743 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.994837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.995057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.995156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.995401 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.995530 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.995715 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.995807 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.996033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.996349 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.996720 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.997209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.997369 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.997542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.997768 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.997897 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.998008 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.998184 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.998327 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.998551 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.998675 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.998863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.998992 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.999187 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.999308 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.999509 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.999637 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.999823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:49.999951 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.000136 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.000265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.000450 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.000578 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.000768 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.000897 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.001081 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.001209 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.001414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.001541 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.001693 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.001813 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.002002 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.002129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.002316 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.003001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.003265 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.003452 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.003655 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.003758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.004072 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.004202 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.004475 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.004687 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.004834 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.005009 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.005150 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.005339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.005469 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.005662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.005787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.005979 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.006082 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.006318 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.006411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.006667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.006778 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.006984 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.007106 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.007318 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.007429 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.007635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.007737 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.007952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.008074 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.008266 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.008378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.008580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.008693 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.008892 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.008986 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.009198 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.009301 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.009512 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.009605 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.009818 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.009911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.010125 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.010228 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.010475 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.010802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.010903 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.010991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.011092 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.011241 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.011385 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.011557 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.011703 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.011888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.011998 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.012221 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.012352 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.012543 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.012640 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.012853 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.013043 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.013165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.013435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.013547 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.013730 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.013857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.014054 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.014163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.014370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.014463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.014707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.014820 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.015023 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.015129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.015335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.015500 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.015661 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.015821 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.015932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.016095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.016252 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.016411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.016568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.016753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.016953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.017095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.017262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.017365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.017574 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.017668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.017922 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.018082 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.018278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.018625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.018806 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.018986 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.019089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.019311 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.019405 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.019621 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.019742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.019946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.020108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.020296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.020458 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.020555 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.020963 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.021067 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.021199 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.021385 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.021498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.021793 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.021978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.022093 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.022182 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.022476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.022842 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023013 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023312 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023450 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023450 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023619 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.023859 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.024064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.024155 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.024377 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.024468 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.024687 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.024781 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.025017 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.025112 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.025333 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.025426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.025644 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.025794 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.025958 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.026058 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.026266 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.026369 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.026607 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.026704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.026916 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.027022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.027230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.027340 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.027545 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.027661 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.027868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.027968 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.028181 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.028288 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.028558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.028696 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.028905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.029037 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.029208 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.029427 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.029528 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.029615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.029835 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.029930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.030146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.030296 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.030464 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.030644 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.031088 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.031229 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.031427 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.031546 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.031743 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.031856 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.032064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.032160 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.032389 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.032490 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.032704 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.032809 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.033019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.033113 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.033336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.033438 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.033705 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.033801 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.034052 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.034163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.034371 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.034532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.034717 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.034811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.035040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.035144 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.035357 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.035459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.035668 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.035769 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.035988 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.036152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.036396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.036509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.036668 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.036770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.036977 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.037079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.037293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.037422 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.037618 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.037935 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.041476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.042788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.043086 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.046153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.046353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.046536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.046725 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.046884 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.047083 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.047262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.047417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.047805 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.047964 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.048114 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.048279 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.048474 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.048640 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.048808 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.048975 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.049783 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.049959 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.050125 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.050293 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.050456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.050677 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.050834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.050834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.051857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.053009 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.053155 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.053306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.053462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.053649 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.053800 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.053952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054117 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.054665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.055690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.055690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.055690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.055690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.056498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.056498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.056785 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.056949 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.057099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.057099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.057385 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.057534 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.057691 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.057843 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.058000 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.058162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.058266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.058443 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.058664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.058862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.058862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059653 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059653 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.059998 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060455 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060535 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.060959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061043 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061116 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061283 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061369 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061536 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061699 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061922 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.061922 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062123 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062217 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062605 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062706 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.062948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063041 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063425 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063517 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063613 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063613 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063769 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063861 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.063946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.064029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.064029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.064266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.064352 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.064472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.064668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.064823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.065005 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.065625 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.065766 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.065865 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.065952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066097 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066318 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066404 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066477 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066597 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066869 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.066953 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.067037 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.067134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.067230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.067324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.067486 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.067581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.067859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.068008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.068227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.068336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.068471 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.068575 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.068799 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.068906 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.069129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.069284 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.069449 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.069593 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.069775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.069926 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.070101 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.070275 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.070427 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.070694 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.070845 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.070997 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.071133 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.071414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.071603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.071851 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.072015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.072153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.072302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.072471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.072612 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.072762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.072915 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.073066 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.073215 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.073418 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.073562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.073733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.073890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.074156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.074326 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.074470 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079373 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079492 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079746 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079819 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.079985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080058 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080200 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080278 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080551 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080868 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.080940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081081 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081309 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081384 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081704 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081783 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081854 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.081924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082101 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082243 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082320 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082522 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082875 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.082955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083124 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083273 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083345 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083428 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083501 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.083579 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.085466 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.085611 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.085698 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.085806 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.085912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086100 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086100 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086271 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086370 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.086928 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.087012 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.087296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.087425 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.087605 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.087734 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.087918 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.088241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.088344 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.088585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.088700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.088878 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.088983 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.089198 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.089307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.089517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.089620 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.089828 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.089927 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.090152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.090251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.090471 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.090592 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.090847 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.091051 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.091218 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.091427 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.091598 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.091759 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.091905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.092050 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.092194 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.092347 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.092493 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.092761 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.092943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.093134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.093283 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.093429 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.093583 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.093749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.093904 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.094051 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.094204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.094358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.094538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.094705 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.094862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.095017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.095179 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.095334 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.095494 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.095641 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.095808 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.095999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.099794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.101363 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.101363 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.101363 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.101363 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.101947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.102094 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.102262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.102410 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.102613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.102762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.102918 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.103075 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.103229 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.103378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.103530 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.103691 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.103838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.103992 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.104156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.104304 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.104458 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.104611 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.104756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.104915 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.105075 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.105222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.105368 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.105521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.105678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.105841 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.105841 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.106175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.106334 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.106507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.106675 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.106675 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.106952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.107112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.107258 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.107258 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.107548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.107706 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.107859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.108005 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.108158 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.108332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.108648 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.108813 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.108969 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.109122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.109276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.109429 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.109590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.109590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.109998 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.109998 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.110291 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.110457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.110645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.110793 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.110938 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.111094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.111248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.111248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.111542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.111689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.112355 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.112503 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.112656 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.112853 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.113034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.113182 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.113336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.113491 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.113647 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.113795 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.113941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.114154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.114154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.114418 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.120177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.120360 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.120520 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.120669 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.120816 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.120816 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.121115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.121115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.121415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.121415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.121704 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.121864 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.122025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.122173 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.122326 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.122473 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.122663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.122821 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.122969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.123114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.123269 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.123423 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.123578 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.123734 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.123898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.124045 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.124193 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.124345 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.124507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.124674 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.124827 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.124978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.125129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.125289 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.125442 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.125604 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.125774 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.125928 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.126079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.126230 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.126551 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.126716 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.126716 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.127022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.127185 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.127408 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.128096 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.128253 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.128402 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.128580 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.128981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.129139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.129297 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.129453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.129601 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.129754 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.129900 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.130061 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.130312 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.130475 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.130662 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.130820 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.130976 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.131133 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.131291 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.131445 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.131600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.131747 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.131892 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.132052 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.132206 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.132353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.132498 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.132644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.132800 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.132961 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.133108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.133254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.133399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.133399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.133692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.133839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.134007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.134193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.134340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.134517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.134685 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.134846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.134992 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.135146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.135146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.135146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.135569 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.135716 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.135863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.136008 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.136153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.136298 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.136503 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.136655 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.136655 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.136944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.137097 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.137252 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.137399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.137399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.137399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.137813 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.137969 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.138124 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.138278 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.138432 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.138432 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.138799 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.139201 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.139374 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.139536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.139689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.139840 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.139994 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.140155 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.140335 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.140578 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.140747 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.140901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.141070 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.141248 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.141413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.141567 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.141725 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.141725 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.142015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.142015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.142328 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.142526 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.142697 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.142858 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.143122 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.143314 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.143469 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.143621 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.143772 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.143932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.144100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.144254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.144405 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.144558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.144716 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.144877 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.145039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.145211 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.145365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.145516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.145668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.145820 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.145981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.146142 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.146295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.146447 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.146685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.146839 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.147004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.147157 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.147322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.147473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.147625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.147785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.147937 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.148097 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.148257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.148411 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.148570 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.148570 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.148875 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.149327 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.149500 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.149661 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.149822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.149985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.150138 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.150288 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.150442 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.150746 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.150925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.151085 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.151243 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.151397 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.151550 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.151550 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.151868 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.151868 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.152159 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.152319 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.152471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.152631 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.152631 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.152943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153098 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153256 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153409 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153409 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.153720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.154909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.156295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.156295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.156295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.156295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.156295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.156295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.156295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.157490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.158735 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.158735 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.158735 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.158735 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.158735 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.159921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.160336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.160672 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.161002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.161333 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.161659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.161982 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.162306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.162662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.162972 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.163280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.163594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.163908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.164212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.164535 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.164846 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.165230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.165502 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.165812 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.167356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.167356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.167356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.167844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.168006 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.168251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.168562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.168889 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.169362 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.169962 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.170591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.170920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.171246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.171680 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.172005 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.172319 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.172629 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.172942 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.173249 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.173608 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.173918 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.174786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.175498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.175498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.175831 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.175984 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.176391 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.176663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.176978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.177283 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.177595 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.177899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.178210 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.178536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.178850 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.179153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.179484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.180050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.181148 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.181480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.181796 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.182126 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.182443 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.182787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.183144 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.183463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.184064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.184398 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.184723 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.185071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.185403 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.185707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.186001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.186306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.186659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.186975 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.187287 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.187598 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.187911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.188222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.188533 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.188846 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.189156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.189465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.189775 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.191047 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.191346 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.191657 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.191967 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.192286 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.192643 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.192968 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.193286 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.193605 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.193925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.194237 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.194571 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.194890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.195200 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.197782 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.198176 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.198541 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.198876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.199337 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.199672 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.200010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.200345 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.200667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.201274 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.201614 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.201947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.202264 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.202615 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.202957 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.203307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.203644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.203978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.204300 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.204612 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.204922 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.205236 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.205641 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.206067 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.206271 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.206609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.206972 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.207231 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.207542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.207851 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.208160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.208474 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.208782 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.209089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.209395 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.209701 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.210007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.210403 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.210648 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.211242 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.211566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.211740 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.212054 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.212327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.212676 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.213007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.213325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.213654 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.213969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.214291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.214644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.214971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.215293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.215617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.215930 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.216267 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.216580 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.216896 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.217238 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.217525 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.217837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.218150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.218522 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.218836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.219142 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.219470 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.219790 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.220118 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.220566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.220744 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.221473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.221808 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.222149 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.222458 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.222684 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.222841 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.223162 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.223484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.223802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.224124 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.224446 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.224780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.225108 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.225420 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.225747 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.226107 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.226462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.226864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.227218 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.227539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.227850 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.228165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.228473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:35:50.228720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:35:50.302641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO dbcounter [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Registered counter for database nova_api Aug 04 02:35:50.323320 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_db.sqlalchemy.engines [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.334698 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writer thread running {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.383565 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO dbcounter [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Registered counter for database nova_api Aug 04 02:35:50.393833 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.context [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d67d506-3efa-49a4-9082-a0012026440f(cell1) {{(pid=124996) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:35:50.398151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:35:50.399804 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:35:50.400616 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:35:50.402751 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:35:50.404226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_db.sqlalchemy.engines [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.404832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO dbcounter [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Registered counter for database nova_cell0 Aug 04 02:35:50.409377 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO dbcounter [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Registered counter for database nova_cell1 Aug 04 02:35:50.411457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writer thread running {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.416703 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_db.sqlalchemy.engines [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.418148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_db.sqlalchemy.engines [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.424369 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writer thread running {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.427035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writer thread running {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.468907 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.context [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d67d506-3efa-49a4-9082-a0012026440f(cell1) {{(pid=124997) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:35:50.473490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:35:50.475120 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:35:50.475919 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:35:50.477910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:35:50.479955 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO dbcounter [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Registered counter for database nova_cell0 Aug 04 02:35:50.484138 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO dbcounter [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Registered counter for database nova_cell1 Aug 04 02:35:50.491613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_db.sqlalchemy.engines [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.493374 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_db.sqlalchemy.engines [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.499644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writer thread running {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.500977 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writer thread running {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.573126 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO dbcounter [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Registered counter for database nova_cell0 Aug 04 02:35:50.580148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_db.sqlalchemy.engines [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.585427 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writer thread running {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.648263 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO dbcounter [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Registered counter for database nova_cell0 Aug 04 02:35:50.655018 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_db.sqlalchemy.engines [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:35:50.660227 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writer thread running {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:35:50.909389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: WARNING keystonemiddleware.auth_token [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:35:50.916679 dv-cinder-740146-17-smb devstack@n-api.service[124996]: WARNING keystonemiddleware.auth_token [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:35:50.982420 dv-cinder-740146-17-smb devstack@n-api.service[124997]: WARNING keystonemiddleware.auth_token [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:35:50.990791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: WARNING keystonemiddleware.auth_token [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:35:51.263759 dv-cinder-740146-17-smb devstack@n-api.service[124996]: WARNING keystonemiddleware.auth_token [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:35:51.270749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: WARNING keystonemiddleware.auth_token [None req-71ffff64-4c14-46eb-bb98-f34956b408be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:35:51.277188 dv-cinder-740146-17-smb devstack@n-api.service[124996]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604887ba9c0 pid: 124996 (default app) Aug 04 02:35:51.336128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: WARNING keystonemiddleware.auth_token [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:35:51.342121 dv-cinder-740146-17-smb devstack@n-api.service[124997]: WARNING keystonemiddleware.auth_token [None req-c9a030ca-d443-48e2-a78d-8cee5048fc0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:35:51.348406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604887ba9c0 pid: 124997 (default app) Aug 04 02:36:26.864127 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.864859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.865718 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.866660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.214558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.214558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.214558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.214558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.121177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2617236a-b9bd-4a4f-b27f-39608e9e46ab tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Action: 'create', calling method: .version_select at 0x7fa64cb14d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2054909415"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:28.504056 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b7410d34-0fbf-4829-ac37-2f39fc3b1998 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Action: 'create', calling method: .version_select at 0x7fa64cb12d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1332335916", "metadata": {"Type": "work"}}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b7410d34-0fbf-4829-ac37-2f39fc3b1998 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Request method failure captured: Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 122 Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCrYiDubWxMXCQqzusNZUD9jG1mYMmhW44hfPp2_wHRt5RSCIIcRSJZZiVCZIpsmGay7FXCvZZ2Ob0DWhyuiqyxo0fpvoue5vOLnmBo14WxG-4Y-vA-J0cvsHGtprqHOtDc4Hb-mhz82YvdnvG0uvVb3h_hY0TbmKA02WdqxcWDljg Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:28.510870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 630198109cbc4939a9c55361df0b85ee Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1332335916", "metadata": {"Type": "work"}}} Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:28.512378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1332335916', 'metadata': {'Type': 'work'}}}} Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise error Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:28.513260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 02:36:28.515932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 02:36:28.517292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 02:36:28.517292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.517292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b7410d34-0fbf-4829-ac37-2f39fc3b1998 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:28.517292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b7410d34-0fbf-4829-ac37-2f39fc3b1998 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.308167 Aug 04 02:36:28.517292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 4 02:36:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 02:36:28.522726 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fd39e68c-fabe-464b-8160-5f66cc2d4601 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Action: 'create', calling method: .version_select at 0x7fa64c9f6820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-706555487", "metadata": {"Type": "work"}}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fd39e68c-fabe-464b-8160-5f66cc2d4601 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Request method failure captured: Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 119 Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCrYiDubWxMXCQqzusNZUD9jG1mYMmhW44hfPp2_wHRt5RSCIIcRSJZZiVCZIpsmGay7FXCvZZ2Ob0DWhyuiqyxo0fpvoue5vOLnmBo14WxG-4Y-vA-J0cvsHGtprqHOtDc4Hb-mhz82YvdnvG0uvVb3h_hY0TbmKA02WdqxcWDljg Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:28.526313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 630198109cbc4939a9c55361df0b85ee Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-706555487", "metadata": {"Type": "work"}}} Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:28.527810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-706555487', 'metadata': {'Type': 'work'}}}} Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise error Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi '0' Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:28.528619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 02:36:28.530150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 02:36:28.532523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 02:36:28.532523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.532523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fd39e68c-fabe-464b-8160-5f66cc2d4601 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:28.532523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fd39e68c-fabe-464b-8160-5f66cc2d4601 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008803 Aug 04 02:36:28.532523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 2/2] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 4 02:36:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 02:36:28.537727 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-71630a2e-0d70-456d-a464-61df25ee3ee4 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Action: 'create', calling method: .version_select at 0x7fa64c9cc8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1391619871", "metadata": {"Type": "work"}}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-71630a2e-0d70-456d-a464-61df25ee3ee4 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Request method failure captured: Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 119 Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCrYiDubWxMXCQqzusNZUD9jG1mYMmhW44hfPp2_wHRt5RSCIIcRSJZZiVCZIpsmGay7FXCvZZ2Ob0DWhyuiqyxo0fpvoue5vOLnmBo14WxG-4Y-vA-J0cvsHGtprqHOtDc4Hb-mhz82YvdnvG0uvVb3h_hY0TbmKA02WdqxcWDljg Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:28.545034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 630198109cbc4939a9c55361df0b85ee Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1391619871", "metadata": {"Type": "work"}}} Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:28.546456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1391619871', 'metadata': {'Type': 'work'}}}} Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise error Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi '' Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:28.548292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 02:36:28.550002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 02:36:28.551789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 02:36:28.551789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.551789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-71630a2e-0d70-456d-a464-61df25ee3ee4 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:28.551789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-71630a2e-0d70-456d-a464-61df25ee3ee4 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009356 Aug 04 02:36:28.551789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 3/3] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 4 02:36:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:36:28.556141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f0739710-390c-4fe6-9a95-f4670bd85c6f tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Calling method '.version_select at 0x7fa64c9cc5e0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:28.955248 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-f0739710-390c-4fe6-9a95-f4670bd85c6f tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] HTTP exception thrown: Volume tempest-invalid-1708905634 could not be found. Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f0739710-390c-4fe6-9a95-f4670bd85c6f tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Request method failure captured: Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1708905634 HTTP/1.1 Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCrYiDubWxMXCQqzusNZUD9jG1mYMmhW44hfPp2_wHRt5RSCIIcRSJZZiVCZIpsmGay7FXCvZZ2Ob0DWhyuiqyxo0fpvoue5vOLnmBo14WxG-4Y-vA-J0cvsHGtprqHOtDc4Hb-mhz82YvdnvG0uvVb3h_hY0TbmKA02WdqxcWDljg Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:28.959019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 630198109cbc4939a9c55361df0b85ee Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Volume tempest-invalid-1708905634 could not be found. Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': 'tempest-invalid-1708905634'} Aug 04 02:36:28.960386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1708905634 could not be found. (HTTP 404) (Request-ID: req-2053de70-84bb-4daa-8420-405137ac6579) Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.961161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:36:28.962291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1708905634 could not be found. Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:36:28.965079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1708905634 could not be found. Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1708905634 could not be found. Aug 04 02:36:28.967683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:28.969870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f0739710-390c-4fe6-9a95-f4670bd85c6f tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Returning 404 to user: Volume tempest-invalid-1708905634 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:28.971020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f0739710-390c-4fe6-9a95-f4670bd85c6f tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1708905634" status: 404 len: 99 microversion: 2.1 time: 0.420707 Aug 04 02:36:28.976914 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 4/4] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 4 02:36:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1708905634 => generated 99 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 02:36:28.982539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8276f7a7-b8e5-451f-b98d-cea5a02b290a tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004223 Aug 04 02:36:28.988124 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 5/5] 10.222.0.60 () {58 vars in 1140 bytes} [Thu Aug 4 02:36:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 02:36:28.993696 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a9700314-1842-45f2-9076-3ba8248502ff tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003888 Aug 04 02:36:28.994473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 6/6] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 4 02:36:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 04 02:36:29.005764 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b127627c-d929-4ee2-a924-66696626b28e tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Calling method '.version_select at 0x7fa64c8ffb80>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:29.038224 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-b127627c-d929-4ee2-a924-66696626b28e tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] HTTP exception thrown: Volume c3c645cb-6461-4530-b29c-104bd6e93af3 could not be found. Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b127627c-d929-4ee2-a924-66696626b28e tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Request method failure captured: Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: DELETE /compute/v2.1/os-volumes/c3c645cb-6461-4530-b29c-104bd6e93af3 HTTP/1.1 Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCrYiDubWxMXCQqzusNZUD9jG1mYMmhW44hfPp2_wHRt5RSCIIcRSJZZiVCZIpsmGay7FXCvZZ2Ob0DWhyuiqyxo0fpvoue5vOLnmBo14WxG-4Y-vA-J0cvsHGtprqHOtDc4Hb-mhz82YvdnvG0uvVb3h_hY0TbmKA02WdqxcWDljg Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:29.040894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 630198109cbc4939a9c55361df0b85ee Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Volume c3c645cb-6461-4530-b29c-104bd6e93af3 could not be found. Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': 'c3c645cb-6461-4530-b29c-104bd6e93af3'} Aug 04 02:36:29.042180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3c645cb-6461-4530-b29c-104bd6e93af3 could not be found. (HTTP 404) (Request-ID: req-a9bb0d32-b889-4aea-9459-70e33a0b62f9) Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:29.043010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:36:29.044089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3c645cb-6461-4530-b29c-104bd6e93af3 could not be found. Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 02:36:29.045741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3c645cb-6461-4530-b29c-104bd6e93af3 could not be found. Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3c645cb-6461-4530-b29c-104bd6e93af3 could not be found. Aug 04 02:36:29.048297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.056613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b127627c-d929-4ee2-a924-66696626b28e tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Returning 404 to user: Volume c3c645cb-6461-4530-b29c-104bd6e93af3 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:29.056613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b127627c-d929-4ee2-a924-66696626b28e tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/c3c645cb-6461-4530-b29c-104bd6e93af3" status: 404 len: 109 microversion: 2.1 time: 0.051108 Aug 04 02:36:29.057217 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 7/7] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:36:28 2022] DELETE /compute/v2.1/os-volumes/c3c645cb-6461-4530-b29c-104bd6e93af3 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:36:29.063133 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8a4e0cc1-5dc2-4889-90d1-7d9d2b2ab113 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Calling method '.version_select at 0x7fa64c8ff670>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:29.100091 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-8a4e0cc1-5dc2-4889-90d1-7d9d2b2ab113 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] HTTP exception thrown: Volume 97989716-e28e-4e94-b6d9-fdfdef257fc8 could not be found. Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8a4e0cc1-5dc2-4889-90d1-7d9d2b2ab113 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Request method failure captured: Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/os-volumes/97989716-e28e-4e94-b6d9-fdfdef257fc8 HTTP/1.1 Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCrYiDubWxMXCQqzusNZUD9jG1mYMmhW44hfPp2_wHRt5RSCIIcRSJZZiVCZIpsmGay7FXCvZZ2Ob0DWhyuiqyxo0fpvoue5vOLnmBo14WxG-4Y-vA-J0cvsHGtprqHOtDc4Hb-mhz82YvdnvG0uvVb3h_hY0TbmKA02WdqxcWDljg Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:29.100762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/448b55f570f54489acf6ddc99a3b0bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 448b55f570f54489acf6ddc99a3b0bc8 Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesNegativeTest-709658465 Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 630198109cbc4939a9c55361df0b85ee Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesNegativeTest-709658465-project Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Volume 97989716-e28e-4e94-b6d9-fdfdef257fc8 could not be found. Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '97989716-e28e-4e94-b6d9-fdfdef257fc8'} Aug 04 02:36:29.102015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97989716-e28e-4e94-b6d9-fdfdef257fc8 could not be found. (HTTP 404) (Request-ID: req-65ec817f-fe8d-4769-bf73-830c64b5ad18) Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:29.102970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:29.104095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97989716-e28e-4e94-b6d9-fdfdef257fc8 could not be found. Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:36:29.107465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97989716-e28e-4e94-b6d9-fdfdef257fc8 could not be found. Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97989716-e28e-4e94-b6d9-fdfdef257fc8 could not be found. Aug 04 02:36:29.111069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:29.113791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8a4e0cc1-5dc2-4889-90d1-7d9d2b2ab113 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] Returning 404 to user: Volume 97989716-e28e-4e94-b6d9-fdfdef257fc8 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:29.115456 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8a4e0cc1-5dc2-4889-90d1-7d9d2b2ab113 tempest-VolumesNegativeTest-709658465 tempest-VolumesNegativeTest-709658465-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/97989716-e28e-4e94-b6d9-fdfdef257fc8" status: 404 len: 109 microversion: 2.1 time: 0.056515 Aug 04 02:36:29.124989 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 8/8] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:36:29 2022] GET /compute/v2.1/os-volumes/97989716-e28e-4e94-b6d9-fdfdef257fc8 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:36:30.080839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2617236a-b9bd-4a4f-b27f-39608e9e46ab tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.227520 Aug 04 02:36:30.082355 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 1/9] 10.222.0.60 () {60 vars in 1155 bytes} [Thu Aug 4 02:36:26 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3231 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 02:36:30.101717 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-41981640-6da5-4c87-9b80-90865283bda1 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c8fff70>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:30.242201 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-41981640-6da5-4c87-9b80-90865283bda1 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41" status: 200 len: 345 microversion: 2.1 time: 0.149582 Aug 04 02:36:30.243048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 9/10] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:36:30 2022] GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:31.447970 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-83f9649a-6106-40c1-b277-e23f9fe77aa4 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c96cb80>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:31.447970 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-83f9649a-6106-40c1-b277-e23f9fe77aa4 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41" status: 200 len: 346 microversion: 2.1 time: 0.119817 Aug 04 02:36:31.447970 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 2/11] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:36:31 2022] GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:36:31.451546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-56b1c7d1-99db-41d2-8b5d-60e1c019d9b7 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Action: 'create', calling method: .version_select at 0x7fa64c8ff820>, body: {"snapshot": {"volume_id": "5bb7de23-72d8-4e27-8ba1-6b4de7b57a41", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-565756908"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:32.188692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-56b1c7d1-99db-41d2-8b5d-60e1c019d9b7 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.805381 Aug 04 02:36:32.195142 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 10/12] 10.222.0.60 () {60 vars in 1162 bytes} [Thu Aug 4 02:36:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:32.200648 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4044e155-0ee8-4076-9ed8-ed48de0219ee tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c983280>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:32.371389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4044e155-0ee8-4076-9ed8-ed48de0219ee tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5" status: 200 len: 286 microversion: 2.1 time: 0.174816 Aug 04 02:36:32.372488 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 3/13] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 4 02:36:32 2022] GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:32.383001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5330eb80-c719-4bf8-804f-91adf590d338 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c932b80>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:32.475940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5330eb80-c719-4bf8-804f-91adf590d338 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096664 Aug 04 02:36:32.476887 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 11/14] 10.222.0.60 () {58 vars in 1140 bytes} [Thu Aug 4 02:36:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:32.499092 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-32e4793c-7468-4514-8964-d76a81e28778 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c9839d0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:32.586796 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-32e4793c-7468-4514-8964-d76a81e28778 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5" status: 200 len: 286 microversion: 2.1 time: 0.098454 Aug 04 02:36:32.594554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 4/15] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 4 02:36:32 2022] GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5 => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:33.602473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-cd67635a-3824-4e27-af42-7c01e28de883 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c932700>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:33.672605 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-cd67635a-3824-4e27-af42-7c01e28de883 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5" status: 200 len: 287 microversion: 2.1 time: 0.073822 Aug 04 02:36:33.673896 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 12/16] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 4 02:36:33 2022] GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:33.685395 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-220846ac-24d2-4711-806f-2869e8feda19 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c96cdc0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:33.936670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-220846ac-24d2-4711-806f-2869e8feda19 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5" status: 202 len: 0 microversion: 2.1 time: 0.255155 Aug 04 02:36:33.940897 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 5/17] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 4 02:36:33 2022] DELETE /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:36:33.946765 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b015dfd5-603d-4ebe-9ecb-93f2aa154524 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c937040>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:33.990606 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b015dfd5-603d-4ebe-9ecb-93f2aa154524 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5" status: 200 len: 286 microversion: 2.1 time: 0.047918 Aug 04 02:36:33.991546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 13/18] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 4 02:36:33 2022] GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:35.005921 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7a21dc8e-0861-4465-876b-ce957f211126 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c983b80>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:35.059405 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-7a21dc8e-0861-4465-876b-ce957f211126 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] HTTP exception thrown: Snapshot 3b639dd8-9716-4e70-a39d-25c120afbba5 could not be found. Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7a21dc8e-0861-4465-876b-ce957f211126 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Request method failure captured: Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5 HTTP/1.1 Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zCqzzKJeRzNkdHy3X3Q0uFv23qe9wZx_3qrPMGR1G7oQPaeJT_V4Tt8q3QIrs2XXW2c1IaIUnmlRlH6YCVv0b_2UipWSC5uRAV1VZ22sVTT1-ktwKpVazclNnX53CrU8JMuk7AIwibaFvIONEb87gOwZAXXcA-q23qgmPV9KyFyF-g Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:36:35.067143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_665b55428ee3418e81787962fdef4d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: cd0e74d35ca74099b04e28e5826f29c3 Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Snapshot 3b639dd8-9716-4e70-a39d-25c120afbba5 could not be found. Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '3b639dd8-9716-4e70-a39d-25c120afbba5'} Aug 04 02:36:35.068462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3b639dd8-9716-4e70-a39d-25c120afbba5 could not be found. (HTTP 404) (Request-ID: req-e0e99bf5-b72c-4b17-8844-aa29b133f321) Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:35.069139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:35.070024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3b639dd8-9716-4e70-a39d-25c120afbba5 could not be found. Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 02:36:35.071057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3b639dd8-9716-4e70-a39d-25c120afbba5 could not be found. Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3b639dd8-9716-4e70-a39d-25c120afbba5 could not be found. Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7a21dc8e-0861-4465-876b-ce957f211126 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Returning 404 to user: Snapshot 3b639dd8-9716-4e70-a39d-25c120afbba5 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:35.072966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7a21dc8e-0861-4465-876b-ce957f211126 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5" status: 404 len: 111 microversion: 2.1 time: 0.066103 Aug 04 02:36:35.074346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 6/19] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 4 02:36:34 2022] GET /compute/v2.1/os-snapshots/3b639dd8-9716-4e70-a39d-25c120afbba5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:36:35.076518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bf69299f-3064-4ee5-bd40-6ece9cce45e8 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c9cc5e0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:35.365296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bf69299f-3064-4ee5-bd40-6ece9cce45e8 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41" status: 202 len: 0 microversion: 2.1 time: 0.291559 Aug 04 02:36:35.369706 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 14/20] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:36:35 2022] DELETE /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:36:35.381591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-22d5f6e1-f223-4974-ba76-281c20db55c2 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c8e84c0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:35.508867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-22d5f6e1-f223-4974-ba76-281c20db55c2 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41" status: 200 len: 345 microversion: 2.1 time: 0.137744 Aug 04 02:36:35.509816 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 7/21] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:36:35 2022] GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:36:36.527194 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b2f2ad4c-600a-457a-93ba-7e961e10a4f3 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c932f70>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:36.582466 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-b2f2ad4c-600a-457a-93ba-7e961e10a4f3 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] HTTP exception thrown: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b2f2ad4c-600a-457a-93ba-7e961e10a4f3 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Request method failure captured: Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 HTTP/1.1 Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCqzzKJeRzNkdHy3X3Q0uFv23qe9wZx_3qrPMGR1G7oQPaeJT_V4Tt8q3QIrs2XXW2c1IaIUnmlRlH6YCVv0b_2UipWSC5uRAV1VZ22sVTT1-ktwKpVazclNnX53CrU8JMuk7AIwibaFvIONEb87gOwZAXXcA-q23qgmPV9KyFyF-g Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:36.583540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_665b55428ee3418e81787962fdef4d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: cd0e74d35ca74099b04e28e5826f29c3 Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '5bb7de23-72d8-4e27-8ba1-6b4de7b57a41'} Aug 04 02:36:36.584600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. (HTTP 404) (Request-ID: req-9b7feedf-a2f6-4d0b-82e8-4318e78b6867) Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.585268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:36.586197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:36:36.587141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.587999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.591122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b2f2ad4c-600a-457a-93ba-7e961e10a4f3 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Returning 404 to user: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:36.592331 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b2f2ad4c-600a-457a-93ba-7e961e10a4f3 tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41" status: 404 len: 109 microversion: 2.1 time: 0.072542 Aug 04 02:36:36.593180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 15/22] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:36:36 2022] GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:36:36.612043 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4d798402-acea-4220-89b9-6de0aeb0fcac tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c8e8b80>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:36.679632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-4d798402-acea-4220-89b9-6de0aeb0fcac tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] HTTP exception thrown: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4d798402-acea-4220-89b9-6de0aeb0fcac tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Request method failure captured: Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 HTTP/1.1 Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zCqzzKJeRzNkdHy3X3Q0uFv23qe9wZx_3qrPMGR1G7oQPaeJT_V4Tt8q3QIrs2XXW2c1IaIUnmlRlH6YCVv0b_2UipWSC5uRAV1VZ22sVTT1-ktwKpVazclNnX53CrU8JMuk7AIwibaFvIONEb87gOwZAXXcA-q23qgmPV9KyFyF-g Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:36:36.682286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_665b55428ee3418e81787962fdef4d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: cd0e74d35ca74099b04e28e5826f29c3 Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '5bb7de23-72d8-4e27-8ba1-6b4de7b57a41'} Aug 04 02:36:36.683375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. (HTTP 404) (Request-ID: req-7269544c-f3c6-453b-89b3-3f2a1fad87f8) Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.684142 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:36:36.685035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 02:36:36.690211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4d798402-acea-4220-89b9-6de0aeb0fcac tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Returning 404 to user: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4d798402-acea-4220-89b9-6de0aeb0fcac tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41" status: 404 len: 109 microversion: 2.1 time: 0.079532 Aug 04 02:36:36.693780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 8/23] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:36:36 2022] DELETE /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:36:36.696407 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-52eeefd9-375b-4f2b-8ed5-d91b73735f1e tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Calling method '.version_select at 0x7fa64c9329d0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:36.745791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-52eeefd9-375b-4f2b-8ed5-d91b73735f1e tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] HTTP exception thrown: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-52eeefd9-375b-4f2b-8ed5-d91b73735f1e tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Request method failure captured: Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 HTTP/1.1 Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zCqzzKJeRzNkdHy3X3Q0uFv23qe9wZx_3qrPMGR1G7oQPaeJT_V4Tt8q3QIrs2XXW2c1IaIUnmlRlH6YCVv0b_2UipWSC5uRAV1VZ22sVTT1-ktwKpVazclNnX53CrU8JMuk7AIwibaFvIONEb87gOwZAXXcA-q23qgmPV9KyFyF-g Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:36:36.750460 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_665b55428ee3418e81787962fdef4d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/665b55428ee3418e81787962fdef4d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 665b55428ee3418e81787962fdef4d1a Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1057049823 Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: cd0e74d35ca74099b04e28e5826f29c3 Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1057049823-project Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '5bb7de23-72d8-4e27-8ba1-6b4de7b57a41'} Aug 04 02:36:36.751566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. (HTTP 404) (Request-ID: req-72da03ea-8ac5-4c5b-9e17-34e733e92f92) Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.752222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:36:36.753104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:36:36.760307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-52eeefd9-375b-4f2b-8ed5-d91b73735f1e tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] Returning 404 to user: Volume 5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-52eeefd9-375b-4f2b-8ed5-d91b73735f1e tempest-VolumesSnapshotsTestJSON-1057049823 tempest-VolumesSnapshotsTestJSON-1057049823-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41" status: 404 len: 109 microversion: 2.1 time: 0.064634 Aug 04 02:36:36.761268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 16/24] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:36:36 2022] GET /compute/v2.1/os-volumes/5bb7de23-72d8-4e27-8ba1-6b4de7b57a41 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:36:43.442756 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-507666921", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "networks": [{"uuid": "2539fd77-5f3f-491b-8161-212d663eb63d"}]}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:43.670181 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] validate_networks() for [('2539fd77-5f3f-491b-8161-212d663eb63d', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:36:46.805988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:36:46.806663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:36:46.807073 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:36:46.807709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:36:46.808234 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:36:46.830024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:46.830471 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:46.838861 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:46.841288 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:46.953491 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Getting quotas for project a9b0b8e8bfa74696bea98b9aa0f19951. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:36:46.959273 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Getting quotas for user d8bc44049ca2427883806568abab2681 and project a9b0b8e8bfa74696bea98b9aa0f19951. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:36:46.987650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:36:46.996222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:36:47.284169 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-90d450c5-b69d-4563-b5ef-dc905d686eaa tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.119278 Aug 04 02:36:47.287298 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 9/25] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:36:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:36:47.317080 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ec1eaaf1-4f35-483f-a942-9d896ece802a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:47.324830 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ec1eaaf1-4f35-483f-a942-9d896ece802a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:47.722009 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ec1eaaf1-4f35-483f-a942-9d896ece802a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:47.755241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ec1eaaf1-4f35-483f-a942-9d896ece802a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1214 microversion: 2.1 time: 0.449666 Aug 04 02:36:47.765404 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 10/26] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:47 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1214 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:48.108137 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2da09577-0f97-46cf-b752-98761000d415 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'create', calling method: .version_select at 0x7fa64c932c10>, body: {"keypair": {"name": "tempest-keypair-1865226023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXvBRfRGUgkq+jJaLzEhm+UxsiOjj9o/iRd5o2H8XzVWM8YMpFN7g6cTQmKgDYSqiRSQ7UE4Qhx+FI8IrevMfwka/I0bJPzzCPNYV/5dG/5Y2pBiLMuqjRoBCxsS072aA=="}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:48.375476 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-2da09577-0f97-46cf-b752-98761000d415 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:36:48.393113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-2da09577-0f97-46cf-b752-98761000d415 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for user 99068d55e19e4b3cbf9197ca46d86fd3 and project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:36:48.604393 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2da09577-0f97-46cf-b752-98761000d415 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.475513 Aug 04 02:36:48.605441 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 17/27] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:36:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:36:48.777236 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-43371c63-d6d9-4aad-bd78-6d0bf734caf9 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:48.778847 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-43371c63-d6d9-4aad-bd78-6d0bf734caf9 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:48.923710 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-43371c63-d6d9-4aad-bd78-6d0bf734caf9 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:48.932498 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-43371c63-d6d9-4aad-bd78-6d0bf734caf9 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1214 microversion: 2.1 time: 0.159009 Aug 04 02:36:48.933511 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 11/28] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:48 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:49.772034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-27e253c6-87bd-4a31-9da5-4d7a912ac990 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'create', calling method: .version_select at 0x7fa64c873040>, body: {"keypair": {"name": "tempest-keypair-1797510353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvZf7SOD33CWJuDqnlXnnnS3z83GY8Gzw0UaxAF6MNre0nM23Ngsy2YVaPxREb3Rrg4mC9yeKTwgDq1kyyRuEk0XGCSGKoc1IaD3IEFQQRCzz/VF9jttOCl5Cz2nQjaZQ=="}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:49.802947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-27e253c6-87bd-4a31-9da5-4d7a912ac990 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:36:49.812800 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-27e253c6-87bd-4a31-9da5-4d7a912ac990 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for user 64be537a50754c838554d1a2e0a4177a and project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:36:49.852457 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-346074646", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:49.942408 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-27e253c6-87bd-4a31-9da5-4d7a912ac990 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.832054 Aug 04 02:36:49.949134 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 18/29] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 4 02:36:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 834 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 02:36:49.958134 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0278aef4-9d50-4525-9ea8-6856ac3f4dc4 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:49.959335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0278aef4-9d50-4525-9ea8-6856ac3f4dc4 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:49.995459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] validate_networks() for [('a1df2c8e-b546-495f-a797-ab719b92ef3e', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:36:50.359739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0278aef4-9d50-4525-9ea8-6856ac3f4dc4 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:50.389905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0278aef4-9d50-4525-9ea8-6856ac3f4dc4 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1214 microversion: 2.1 time: 0.438617 Aug 04 02:36:50.437572 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 19/30] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:49 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1214 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:51.167499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:36:51.168850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:36:51.169875 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:36:51.172480 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:36:51.173149 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:36:51.190223 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:51.190964 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:51.192805 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:51.195439 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:51.256071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for project 651f296b94d342488b3cd98998a08e02. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:36:51.272711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for user 2e47969dca184aec92e620fcd53d6a5c and project 651f296b94d342488b3cd98998a08e02. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:36:51.318099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:36:51.324126 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:36:51.416149 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:51.416796 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:51.432620 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:51.433405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:51.435237 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:51.438603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:51.520838 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8d494e5c-8d4a-450f-a535-7ac1e8191465 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.262810 Aug 04 02:36:51.524995 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 12/31] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:36:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 02:36:51.542598 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f78bde1a-8e1c-4ff4-807a-ed86e332759e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:51.543842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f78bde1a-8e1c-4ff4-807a-ed86e332759e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:51.697368 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f78bde1a-8e1c-4ff4-807a-ed86e332759e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:51.706467 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f78bde1a-8e1c-4ff4-807a-ed86e332759e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1221 microversion: 2.1 time: 0.169152 Aug 04 02:36:51.726571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 13/32] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:51 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1221 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:52.207246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:52.211220 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1315450562", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:52.234973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-74728160-3ac6-42ce-ab31-7e21fa999f16 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1218 microversion: 2.1 time: 0.820627 Aug 04 02:36:52.236861 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 20/33] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:51 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1218 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:52.370972 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] validate_networks() for [('a1df2c8e-b546-495f-a797-ab719b92ef3e', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:36:53.262346 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:53.265349 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:53.282208 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:53.283010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:53.286181 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:53.287286 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:53.432656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:36:53.433189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:36:53.433794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:36:53.434392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:36:53.434991 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:36:53.455174 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:53.458924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:53.460284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:53.462257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:53.539745 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for project 651f296b94d342488b3cd98998a08e02. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:36:53.564352 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for user 2e47969dca184aec92e620fcd53d6a5c and project 651f296b94d342488b3cd98998a08e02. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:36:53.602770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:36:53.602770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:36:53.671471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:53.683860 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-adb60665-3451-45f1-a939-0de66b93df70 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1274 microversion: 2.1 time: 0.425560 Aug 04 02:36:53.685760 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 21/34] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:53 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1274 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:53.820780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8065fd3d-b31e-4175-96a3-7be6d45df14e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.607459 Aug 04 02:36:53.822275 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 14/35] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:36:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:36:53.835267 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ab03826e-b2db-4efb-8cbc-e4afd2f0382f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:53.835889 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ab03826e-b2db-4efb-8cbc-e4afd2f0382f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:54.303016 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ab03826e-b2db-4efb-8cbc-e4afd2f0382f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:54.317659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ab03826e-b2db-4efb-8cbc-e4afd2f0382f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1222 microversion: 2.1 time: 0.485699 Aug 04 02:36:54.318626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 22/36] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:53 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1222 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:54.708343 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:54.709156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:54.725629 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:54.726136 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:54.733389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:54.735308 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:55.208860 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:55.226274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-cb8da5c2-2120-4e84-9b23-ff6a1aa35cc0 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1272 microversion: 2.1 time: 0.522503 Aug 04 02:36:55.240017 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 15/37] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:54 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1272 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:55.341625 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-373f254f-bbd2-40e4-96d5-9305b4b0b623 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:55.344128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-373f254f-bbd2-40e4-96d5-9305b4b0b623 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:55.630968 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-373f254f-bbd2-40e4-96d5-9305b4b0b623 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:55.642598 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-373f254f-bbd2-40e4-96d5-9305b4b0b623 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1222 microversion: 2.1 time: 0.305582 Aug 04 02:36:55.647444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 23/38] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:55 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1222 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:55.692449 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2104531208", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b22a8bf0-7345-42b7-ab28-223e4daaed3c"}], "security_groups": [{"name": "tempest-securitygroup--300643073"}], "key_name": "tempest-keypair-1865226023", "user_data": "}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:56.257323 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:56.258110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:56.273594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:56.276024 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:56.278245 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:56.280312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:56.541504 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] validate_networks() for [('b22a8bf0-7345-42b7-ab28-223e4daaed3c', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:36:56.589997 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:56.600306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-901f174f-ef01-4199-b410-695471824bcf tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1272 microversion: 2.1 time: 0.350627 Aug 04 02:36:56.608455 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 24/39] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:56 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1272 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:36:56.682196 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:56.682776 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:56.714556 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:56.715011 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:56.725864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:56.727498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:56.919596 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:56.939640 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-378a7568-94ad-42cc-87f2-b014976066cf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1226 microversion: 2.1 time: 0.275371 Aug 04 02:36:56.961505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 25/40] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:56 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1226 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:57.634467 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:57.635132 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:57.681071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:57.681071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:57.681071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:57.681071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:58.535545 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:58.551382 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-eea1ff75-539d-46c0-b7b1-60ada477e2a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.915106 Aug 04 02:36:58.557593 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 26/41] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:57 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:58.574870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:58.582153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:58.586026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:58.586862 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:58.588037 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:58.588662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:58.658276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:36:58.659094 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:36:58.659332 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:36:58.659819 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:36:58.660711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:36:58.680518 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:58.686137 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:58.706055 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:58.706645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:58.754282 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:36:58.764274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for user 99068d55e19e4b3cbf9197ca46d86fd3 and project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:36:58.787276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:58.798527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ed49079a-e06d-42f1-acf0-a8e28753c5d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1274 microversion: 2.1 time: 0.239441 Aug 04 02:36:58.817948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 27/42] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:58 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:58.850645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:36:58.853626 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:36:59.098846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6cc4d043-9de1-4a0b-ac45-678a23bbe4bc tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.394419 Aug 04 02:36:59.099282 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1916660217", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a6827f1-0849-4a3c-806a-434939b80eec"}], "security_groups": [{"name": "tempest-securitygroup--75694472"}], "key_name": "tempest-keypair-1797510353", "user_data": "}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:36:59.111587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 16/43] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:36:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 3421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:36:59.117214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3b94f96e-c4af-4e78-9144-5ac082d83fc1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:59.140811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3b94f96e-c4af-4e78-9144-5ac082d83fc1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:59.659549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] validate_networks() for [('2a6827f1-0849-4a3c-806a-434939b80eec', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:36:59.680512 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3b94f96e-c4af-4e78-9144-5ac082d83fc1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:36:59.689866 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3b94f96e-c4af-4e78-9144-5ac082d83fc1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1238 microversion: 2.1 time: 0.582102 Aug 04 02:36:59.708193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 17/44] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:59 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1238 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:36:59.718078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:36:59.719147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:36:59.727519 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:59.728564 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:36:59.729950 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:36:59.730624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:00.656126 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:00.668993 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b8f7f870-4743-41c5-b2b2-66c093beb7eb tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.955280 Aug 04 02:37:00.669587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 18/45] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:36:59 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:00.687500 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:00.688132 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:00.703876 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:00.704434 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:00.705396 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:00.705930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:00.815386 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:00.824822 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1fbcd3ef-b357-4ec3-b157-05622b0a36ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1280 microversion: 2.1 time: 0.151003 Aug 04 02:37:00.826396 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 19/46] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:00 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:00.831598 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-711a28d9-49ea-483b-9dd6-a83754bea747 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:00.832259 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-711a28d9-49ea-483b-9dd6-a83754bea747 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:00.936625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-711a28d9-49ea-483b-9dd6-a83754bea747 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:00.936625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-711a28d9-49ea-483b-9dd6-a83754bea747 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1238 microversion: 2.1 time: 0.085216 Aug 04 02:37:00.936625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 20/47] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:00 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:01.558353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:37:01.558353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:37:01.558353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:37:01.558353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:37:01.558353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:37:01.597413 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:01.597413 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:01.603484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:01.605887 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:01.692093 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:01.692715 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:01.722045 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:37:01.727011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:01.729249 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:01.731829 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:01.732838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for user 64be537a50754c838554d1a2e0a4177a and project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:37:01.738070 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:01.758872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:37:01.766457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:37:02.160695 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c426f368-7bad-454e-ba1e-eddde5196c0f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 3.051709 Aug 04 02:37:02.163973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 28/48] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 4 02:36:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 3074 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 02:37:02.196383 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:02.199748 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:02.226287 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:02.226807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:02.227946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:02.228398 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:02.769738 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:02.793846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-742bb67b-4e77-44f2-945a-afb1bf682590 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 1.105516 Aug 04 02:37:02.801690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 21/49] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:01 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:02.812337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:02.817083 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:02.827009 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:02.833437 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:02.834476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:02.835040 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:03.064679 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:03.102682 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fcd21885-5901-4ada-87d0-94fa13e7cbbe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1290 microversion: 2.1 time: 0.294060 Aug 04 02:37:03.108655 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 22/50] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:02 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1290 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:03.167222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-91276e4d-e37b-4eff-9e6c-19050d14515d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:03.167846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-91276e4d-e37b-4eff-9e6c-19050d14515d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:03.206290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:03.286112 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:03.294640 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-80275e37-b801-45ac-9033-fcb9f9aca819 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 1.126746 Aug 04 02:37:03.311015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 29/51] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:02 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:03.414622 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-91276e4d-e37b-4eff-9e6c-19050d14515d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:03.439851 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-91276e4d-e37b-4eff-9e6c-19050d14515d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:03.441689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-91276e4d-e37b-4eff-9e6c-19050d14515d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:03.449119 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-91276e4d-e37b-4eff-9e6c-19050d14515d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1282 microversion: 2.20 time: 0.316359 Aug 04 02:37:03.450473 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 23/52] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:03 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1282 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:03.510449 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-e45af855-101b-4a68-8f0c-275874b613e6 req-58b2ea79-aa8d-4444-94d1-c1e9807ec584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4d4695-16d8-4b01-9104-7ab9728d75f3", "tag": "ac6c1c23-eb5f-4e9a-9149-bcbf2119420a"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:03.565697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e45af855-101b-4a68-8f0c-275874b613e6 req-58b2ea79-aa8d-4444-94d1-c1e9807ec584 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:03.573819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e45af855-101b-4a68-8f0c-275874b613e6 req-58b2ea79-aa8d-4444-94d1-c1e9807ec584 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:03.651072 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-e45af855-101b-4a68-8f0c-275874b613e6 req-58b2ea79-aa8d-4444-94d1-c1e9807ec584 service nova] Creating event network-changed:ac6c1c23-eb5f-4e9a-9149-bcbf2119420a for instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 on hv-cinder-74014 Aug 04 02:37:03.651072 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e45af855-101b-4a68-8f0c-275874b613e6 req-58b2ea79-aa8d-4444-94d1-c1e9807ec584 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 02:37:03.651072 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08f3f87-e395-42b1-b8dc-f17411e2cabc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:03.651072 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08f3f87-e395-42b1-b8dc-f17411e2cabc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:03.651072 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08f3f87-e395-42b1-b8dc-f17411e2cabc None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:03.652613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08f3f87-e395-42b1-b8dc-f17411e2cabc None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:03.696048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.compute.rpcapi [None req-a08f3f87-e395-42b1-b8dc-f17411e2cabc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 02:37:03.703274 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08f3f87-e395-42b1-b8dc-f17411e2cabc None None] Releasing lock "compute-rpcapi-router" {{(pid=124997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 02:37:03.738099 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a08f3f87-e395-42b1-b8dc-f17411e2cabc None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.427651 Aug 04 02:37:03.738940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 30/53] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:03.820258 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:03.823980 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:03.829898 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:03.834634 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:03.839628 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:03.842541 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:04.139319 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:04.140034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:04.146708 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:04.147461 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:04.148404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:04.156199 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:04.409826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:04.417425 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e4199534-b020-4509-a8f6-5685739c3fe8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1290 microversion: 2.1 time: 0.283367 Aug 04 02:37:04.432408 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 31/54] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:04 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1290 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:04.440901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:04.448729 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:04.461125 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:04.468783 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:04.473391 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:04.473914 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:04.839200 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:04.854378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d0f78c75-4c8e-4251-8726-ece6cdcb1877 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.417219 Aug 04 02:37:04.855030 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 32/55] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:04 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:04.959705 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-19c72bc7-8cb2-4628-b65e-1cac6265b0db req-5ec966ae-f4d6-4695-98ef-4a24e0586417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21754572-a17a-4c62-9a46-d59d25ba3e8c", "tag": "b8b834c3-d502-4593-a9eb-906f65cab6c2"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:04.967505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-19c72bc7-8cb2-4628-b65e-1cac6265b0db req-5ec966ae-f4d6-4695-98ef-4a24e0586417 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:04.967956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-19c72bc7-8cb2-4628-b65e-1cac6265b0db req-5ec966ae-f4d6-4695-98ef-4a24e0586417 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:04.979019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-19c72bc7-8cb2-4628-b65e-1cac6265b0db req-5ec966ae-f4d6-4695-98ef-4a24e0586417 service nova] Creating event network-changed:b8b834c3-d502-4593-a9eb-906f65cab6c2 for instance 21754572-a17a-4c62-9a46-d59d25ba3e8c on hv-cinder-74014 Aug 04 02:37:04.985502 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-19c72bc7-8cb2-4628-b65e-1cac6265b0db req-5ec966ae-f4d6-4695-98ef-4a24e0586417 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128996 Aug 04 02:37:04.986674 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 33/56] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:04.991908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:04.993050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:05.000715 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:05.001164 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:05.001939 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:05.002382 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:05.030275 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:05.059162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-066117a1-08db-4ada-ac60-a411d235ca7e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 1.243052 Aug 04 02:37:05.072453 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 24/57] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:03 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:05.112755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:05.120518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:05.122060 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:05.123888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bd48a3a1-7bd2-49f9-bd02-a523acdb700a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1286 microversion: 2.20 time: 0.135954 Aug 04 02:37:05.124461 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 34/58] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:04 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:05.440900 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:05.442031 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:05.452541 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:05.452969 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:05.454272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:05.454749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:05.583125 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:05.602804 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-94d0cbe2-8351-4d50-b3ed-7e60b976f004 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1308 microversion: 2.1 time: 0.167696 Aug 04 02:37:05.604186 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 25/59] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:05 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:05.881411 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:05.884192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:05.891811 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:05.893042 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:05.894224 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:05.894969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:06.102328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:06.115834 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:06.118843 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:06.129160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-baff5cfd-c7c5-4da1-be28-556b504a8b4d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.253591 Aug 04 02:37:06.129732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 35/60] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:05 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:06.135272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:06.135272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:06.135272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:06.135272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:06.149744 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:06.150381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:06.172342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:06.172342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:06.172342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:06.172342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:06.251453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:06.258450 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:06.260011 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:06.261292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f28baebc-3fa2-481a-abac-5b30a1c29705 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1278 microversion: 2.20 time: 0.115976 Aug 04 02:37:06.261992 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 36/61] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:06 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:06.403340 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:06.413947 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-923e271c-c075-42af-8c59-16a8b610b0b7 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.320877 Aug 04 02:37:06.416322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 26/62] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:06 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:06.631169 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:06.632016 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:06.645259 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:06.645827 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:06.651376 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:06.651376 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:06.722913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:06.732677 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e11355e8-617a-47e8-9a14-6e9f9e299945 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1308 microversion: 2.1 time: 0.107476 Aug 04 02:37:06.734392 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 37/63] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:06 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:07.032643 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-9cf064ab-112a-4afd-8471-afa19e42b89c req-602e0cf2-a7b4-4362-8a2e-329f19e3d2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc200eb6-cfc2-4316-abb2-207a36281bf7", "tag": "d252568c-1f06-4cbc-bf58-fc9263892021"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:07.049784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-9cf064ab-112a-4afd-8471-afa19e42b89c req-602e0cf2-a7b4-4362-8a2e-329f19e3d2dd service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.050577 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-9cf064ab-112a-4afd-8471-afa19e42b89c req-602e0cf2-a7b4-4362-8a2e-329f19e3d2dd service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.073181 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-9cf064ab-112a-4afd-8471-afa19e42b89c req-602e0cf2-a7b4-4362-8a2e-329f19e3d2dd service nova] Creating event network-changed:d252568c-1f06-4cbc-bf58-fc9263892021 for instance bc200eb6-cfc2-4316-abb2-207a36281bf7 on hv-cinder-74014 Aug 04 02:37:07.073787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-9cf064ab-112a-4afd-8471-afa19e42b89c req-602e0cf2-a7b4-4362-8a2e-329f19e3d2dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 02:37:07.075282 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3b3610ac-cfd9-4981-84b3-b20531793223 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.075761 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3b3610ac-cfd9-4981-84b3-b20531793223 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.077255 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3b3610ac-cfd9-4981-84b3-b20531793223 None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.077950 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3b3610ac-cfd9-4981-84b3-b20531793223 None None] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.099495 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.compute.rpcapi [None req-3b3610ac-cfd9-4981-84b3-b20531793223 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 02:37:07.101149 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3b3610ac-cfd9-4981-84b3-b20531793223 None None] Releasing lock "compute-rpcapi-router" {{(pid=124996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 02:37:07.119373 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3b3610ac-cfd9-4981-84b3-b20531793223 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100563 Aug 04 02:37:07.125175 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 27/64] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:07.168437 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:07.170098 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:07.180726 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.181811 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.182948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.183504 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.297148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:07.297862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:07.306184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.306673 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.307456 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.307899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.385344 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:07.394577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-af88f9e4-5564-4c7a-a0b1-e96a63b6ae34 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.232823 Aug 04 02:37:07.395686 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 38/65] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:07 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:07.419789 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:07.430476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:07.432049 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:07.433855 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b196fea0-8a2e-48b8-8e91-4dd14114d3c8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1278 microversion: 2.20 time: 0.143975 Aug 04 02:37:07.434457 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 28/66] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:07 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:07.455434 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:07.456530 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:07.464664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.465375 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.468592 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.477725 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.684156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:07.698408 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-11b03260-2e3e-4581-b40d-6e8ec08b5f68 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.247868 Aug 04 02:37:07.699519 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 39/67] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:07 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:07.755274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:07.756170 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:07.764907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.765781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.766813 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:07.767538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:07.876496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:07.890029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4374f644-d445-4118-b34a-bae00cb744e4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1308 microversion: 2.1 time: 0.138519 Aug 04 02:37:07.890648 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 29/68] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:07 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:08.420068 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:08.420751 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:08.427070 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.427517 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.428278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.428983 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.432893 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=100 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:08.456666 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:08.457542 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:08.463766 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.464217 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.464978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.465427 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.549770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:08.561778 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:08.565485 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:08.565485 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-5e5e2dcd-7834-4223-bbab-42ffbdee14db tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1278 microversion: 2.20 time: 0.111612 Aug 04 02:37:08.565485 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 30/69] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:08 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:37:08.571912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:08.579702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2b0c742e-70ff-4718-bbbf-e66be8212790 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.164372 Aug 04 02:37:08.580288 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 40/70] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:08 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:08.721588 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:08.724204 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:08.734843 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.735808 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.736880 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.737477 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.921656 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:08.923074 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:08.932389 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.935183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.935994 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:08.936564 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:08.990355 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:09.007036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f493b67e-3d14-4af9-be28-56c2e6d2600f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.289307 Aug 04 02:37:09.018731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 31/71] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:08 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:09.019765 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:09.027618 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8400b1d8-cdb7-4b9e-81c4-e21be85e27e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1296 microversion: 2.1 time: 0.110320 Aug 04 02:37:09.028181 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 41/72] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:08 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:09.635228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:09.635228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:09.635228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:09.635228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:09.635924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:09.635924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:09.636075 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:09.636075 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:09.636075 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:09.636075 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:09.636686 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:09.636686 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:09.681287 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:09.694837 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:09.696514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:09.697861 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c8d3d912-9ba8-4c8a-ad5a-33859fbe4834 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1334 microversion: 2.20 time: 0.115168 Aug 04 02:37:09.698650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 32/73] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:09 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:09.771864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:09.779780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d18a41cd-79aa-4db7-91b6-e2d3f866d8e2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.182922 Aug 04 02:37:09.780353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 42/74] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:09 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:10.029527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:10.030751 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:10.051162 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:10.052754 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:10.068379 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.068829 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.069642 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.073143 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.075161 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.076831 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.077966 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.084899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.241273 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:10.257756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-aa75cf8b-c2d5-40e9-bd13-560cf53af498 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1296 microversion: 2.1 time: 0.210386 Aug 04 02:37:10.259366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 43/75] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:10 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1296 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:10.458417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:10.468610 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ca740d41-f53f-4d40-aa74-ef77c432683a tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.443949 Aug 04 02:37:10.469222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 33/76] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:10 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:10.723160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:10.734913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:10.759078 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.761128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.762470 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.765709 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.803122 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:10.807869 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:10.815532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.816971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.818059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:10.820921 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:10.861755 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=100 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:10.960609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:10.973944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:10.980166 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:10.982422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-46cf997f-3d49-4a6e-9746-7403fd56c52a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1342 microversion: 2.20 time: 0.263392 Aug 04 02:37:10.987204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 44/77] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:10 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:11.282358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:11.283217 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:11.286389 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:11.299387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:11.299387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:11.299387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:11.299387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:11.422669 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:11.425591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:11.430413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-24a7cace-a6fc-4593-a872-e377e55ffeee tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.633348 Aug 04 02:37:11.431171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 34/78] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:10 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:11.449329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a3a99f74-7865-422e-9cc0-ae60ec8b15e3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1296 microversion: 2.1 time: 0.170935 Aug 04 02:37:11.462716 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 45/79] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:11 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:11.493450 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:11.494315 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:11.501869 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:11.502322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:11.503149 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:11.503767 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:11.674913 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:11.683137 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fd2a3a3c-b9f9-4d91-b063-6d3c79d3394b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.193509 Aug 04 02:37:11.733774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 35/80] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:11 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:12.022705 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:12.024157 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:12.033302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=20 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:12.035655 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.036266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.037241 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.037822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.177805 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:12.193454 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:12.198982 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:12.208901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2b750e74-91af-4cdb-a15e-e17acbd937e4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1340 microversion: 2.20 time: 0.193280 Aug 04 02:37:12.234366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 46/81] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:12 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:12.453107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:12.453862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:12.461378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.461911 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.463202 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.463720 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.473927 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:12.473927 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:12.483731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.486380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.487252 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.487873 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.889320 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:12.898381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a73f79eb-4705-4c84-98c4-1626f2400bad tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.430415 Aug 04 02:37:12.899592 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 47/82] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:12 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:12.906655 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:12.907761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:12.914383 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.917819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.917819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:12.917819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:12.979468 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:12.991245 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-5a23a121-d77e-419a-a7e3-e5f65fd47e48 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.543014 Aug 04 02:37:12.991840 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 36/83] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:12 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:13.240011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:13.240641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:13.252723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:13.254736 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:13.258424 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:13.258932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:13.306185 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:13.315520 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a08be2df-fb3b-462c-aa63-359c5285dbb5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.414635 Aug 04 02:37:13.325977 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 48/84] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:12 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:13.392983 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:13.405972 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:13.408121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:13.408668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-110047ac-9317-45ec-9090-899355dc8061 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1340 microversion: 2.20 time: 0.173343 Aug 04 02:37:13.411078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 37/85] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:13 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:13.920951 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:13.921597 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:13.924207 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=4 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:13.930034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:13.930597 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:13.931380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:13.931818 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:13.958756 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-5626cdc5-740b-46f2-9daa-31b77c46dd93 req-456f8e95-ac2b-4670-bad1-06c70d438af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1c4809-6fd6-4207-b2e0-7b9801de9c0f", "tag": "0e8ed6f1-6392-4077-a6da-de33241cc091"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:13.969756 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=36 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:13.983811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5626cdc5-740b-46f2-9daa-31b77c46dd93 req-456f8e95-ac2b-4670-bad1-06c70d438af4 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:13.984754 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5626cdc5-740b-46f2-9daa-31b77c46dd93 req-456f8e95-ac2b-4670-bad1-06c70d438af4 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:14.000549 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-5626cdc5-740b-46f2-9daa-31b77c46dd93 req-456f8e95-ac2b-4670-bad1-06c70d438af4 service nova] Creating event network-changed:0e8ed6f1-6392-4077-a6da-de33241cc091 for instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f on hv-cinder-74014 Aug 04 02:37:14.029007 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-5626cdc5-740b-46f2-9daa-31b77c46dd93 req-456f8e95-ac2b-4670-bad1-06c70d438af4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068755 Aug 04 02:37:14.030359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 38/86] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:37:14.040138 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:14.046856 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:14.065874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:14.068862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:14.068862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:14.068862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:14.368577 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:14.393266 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d3bb645b-1546-4222-bee0-69be71fd1bd0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.359705 Aug 04 02:37:14.401885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:14.406763 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 39/87] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:14 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:14.413342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bef61cda-59db-4a45-89da-6c02b59bb33a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.496970 Aug 04 02:37:14.416306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 49/88] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:13 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:14.419138 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:14.421627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:14.432189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:14.432817 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:14.433781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:14.434270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:14.440440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:14.446731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:14.461785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:14.462014 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:14.470288 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:14.470802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:14.847903 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:14.859101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:14.861061 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:14.863003 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-53c642f3-128c-437a-8582-d7a757b51938 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.430735 Aug 04 02:37:14.864465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 50/89] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:14 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:37:15.096232 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:15.104541 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f7394be1-3f80-4a04-b775-1afd172e10b8 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.696410 Aug 04 02:37:15.114652 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 40/90] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:14 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:15.290697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-ff516a64-b100-4d0a-900a-ecc3d6887330 req-bb674cdd-8c3e-42e4-9c0a-95c59c0678e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88fb61ca-19be-4d4c-a340-ec997691ac10", "tag": "47529bd5-9d31-4f9f-8fd1-96a64c939a51"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:15.301844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-ff516a64-b100-4d0a-900a-ecc3d6887330 req-bb674cdd-8c3e-42e4-9c0a-95c59c0678e6 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:15.302580 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-ff516a64-b100-4d0a-900a-ecc3d6887330 req-bb674cdd-8c3e-42e4-9c0a-95c59c0678e6 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:15.315373 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-ff516a64-b100-4d0a-900a-ecc3d6887330 req-bb674cdd-8c3e-42e4-9c0a-95c59c0678e6 service nova] Creating event network-changed:47529bd5-9d31-4f9f-8fd1-96a64c939a51 for instance 88fb61ca-19be-4d4c-a340-ec997691ac10 on hv-cinder-74014 Aug 04 02:37:15.320788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-ff516a64-b100-4d0a-900a-ecc3d6887330 req-bb674cdd-8c3e-42e4-9c0a-95c59c0678e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033979 Aug 04 02:37:15.321704 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 51/91] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:37:15.420581 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:15.421129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:15.439981 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:15.440739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:15.453593 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:15.454154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:15.455192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:15.455637 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:15.464730 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:15.465328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:15.467543 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:15.468210 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:15.673024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:15.685537 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8b1a9e7f-36d5-4b07-8a5b-4edaf19105c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.272821 Aug 04 02:37:15.686451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 41/92] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:15 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:15.695557 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:15.706309 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-acba64de-6e93-4e1d-b5db-5ceb04eb3d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.270332 Aug 04 02:37:15.707636 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 52/93] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:15 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:15.888515 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:15.890209 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:15.905087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:15.905856 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:15.909191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:15.909191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.013889 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-f21c786a-95d5-49aa-a2ab-7342b06e4123 req-a23640e8-27e1-4999-8349-66ef7fe92aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21754572-a17a-4c62-9a46-d59d25ba3e8c", "name": "network-vif-plugged", "status": "completed", "tag": "b8b834c3-d502-4593-a9eb-906f65cab6c2"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:16.026992 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-f21c786a-95d5-49aa-a2ab-7342b06e4123 req-a23640e8-27e1-4999-8349-66ef7fe92aa9 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:16.027668 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-f21c786a-95d5-49aa-a2ab-7342b06e4123 req-a23640e8-27e1-4999-8349-66ef7fe92aa9 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.044783 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-f21c786a-95d5-49aa-a2ab-7342b06e4123 req-a23640e8-27e1-4999-8349-66ef7fe92aa9 service nova] Creating event network-vif-plugged:b8b834c3-d502-4593-a9eb-906f65cab6c2 for instance 21754572-a17a-4c62-9a46-d59d25ba3e8c on hv-cinder-74014 Aug 04 02:37:16.052579 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-f21c786a-95d5-49aa-a2ab-7342b06e4123 req-a23640e8-27e1-4999-8349-66ef7fe92aa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112548 Aug 04 02:37:16.053739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 53/94] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:16.098346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:16.108501 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:16.110029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:16.111515 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-30df6382-605b-405d-809b-16af29d6e23a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.228899 Aug 04 02:37:16.116458 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 42/95] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:15 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:16.126593 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:16.127516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:16.134191 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:16.134944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.135731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:16.136157 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.332437 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:16.343400 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5f2bd8a0-6627-497f-b990-ab3f20c483a2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.221823 Aug 04 02:37:16.357527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 54/96] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:16 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:16.708996 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:16.709611 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:16.716350 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:16.716793 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.717740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:16.718329 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.730511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:16.730511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:16.742370 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:16.743065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.743837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:16.744431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:16.977954 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:16.978476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:16.987112 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bb5bc361-c232-4608-9ff9-5d0ae903e4ae tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.263196 Aug 04 02:37:16.987430 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a98b276c-a384-4fa5-b76c-8eeebe73cecc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.282219 Aug 04 02:37:16.988010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 43/97] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:16 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:16.991964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 55/98] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:16 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:17.134951 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:17.135511 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:17.137545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=10 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:17.142563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:17.143013 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:17.143780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:17.144373 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:17.284085 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:17.299960 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:17.301515 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:17.302753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-865a2f9c-7313-4059-907f-824af0a02eff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.171760 Aug 04 02:37:17.303588 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 44/99] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:17 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:17.365262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:17.366129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:17.378914 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:17.379440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:17.380435 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:17.380950 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:17.604516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:17.615523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-be9cabe5-9645-4ec0-b7c6-49ddcbd5a5cd tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.251892 Aug 04 02:37:17.616247 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 56/100] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:17 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:18.008550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:18.009152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:18.016049 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.016648 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.017525 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.017668 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:18.018117 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.018274 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:18.026759 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.027810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.050696 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.054001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.169701 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:18.177431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-97fd61b9-2cbe-4554-9815-092cad75e541 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.172679 Aug 04 02:37:18.177996 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 45/101] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:18 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:18.185646 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-d63fed1f-7fa7-425e-8c21-5667842af38e req-99044811-4964-421d-955c-7917af09a727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4d4695-16d8-4b01-9104-7ab9728d75f3", "name": "network-vif-plugged", "status": "completed", "tag": "ac6c1c23-eb5f-4e9a-9149-bcbf2119420a"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:18.197183 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-d63fed1f-7fa7-425e-8c21-5667842af38e req-99044811-4964-421d-955c-7917af09a727 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.197935 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-d63fed1f-7fa7-425e-8c21-5667842af38e req-99044811-4964-421d-955c-7917af09a727 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.210617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:18.210901 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-d63fed1f-7fa7-425e-8c21-5667842af38e req-99044811-4964-421d-955c-7917af09a727 service nova] Creating event network-vif-plugged:ac6c1c23-eb5f-4e9a-9149-bcbf2119420a for instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 on hv-cinder-74014 Aug 04 02:37:18.222780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6b794030-8f76-4574-8c58-b20088a78bdc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.209172 Aug 04 02:37:18.223351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 57/102] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:18 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:18.226969 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-d63fed1f-7fa7-425e-8c21-5667842af38e req-99044811-4964-421d-955c-7917af09a727 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046530 Aug 04 02:37:18.230469 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 46/103] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:18.327074 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:18.327689 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:18.333748 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.336532 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.336532 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.336532 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.339681 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=100 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:18.479291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:18.487927 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:18.489537 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:18.490708 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a84ce4f8-badd-4c67-bb30-c943a75e6285 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.168216 Aug 04 02:37:18.491275 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 58/104] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:18 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:18.638499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:18.639212 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:18.645517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.645967 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.646790 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:18.647230 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:18.809463 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:18.816332 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-45e26b91-6d06-42d4-aad2-0a7f509effda tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.183156 Aug 04 02:37:18.822532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 47/105] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:18 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:19.201826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:19.202444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:19.209118 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.209564 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:19.210365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.210838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:19.249747 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:19.250290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:19.256422 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.256870 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:19.257647 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.258082 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:19.409823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:19.419818 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5ceb2e8a-6576-4802-b372-b1c872248d37 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.222358 Aug 04 02:37:19.420872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 59/106] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:19 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:19.456981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:19.465929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7b3f0654-7b32-49cb-ae75-172cccbfb037 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.221629 Aug 04 02:37:19.466853 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 48/107] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:19 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:19.518331 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:19.520890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:19.527056 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.527511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:19.529217 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.529964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:19.704193 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:19.721285 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:19.722883 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:19.726656 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6d9b76b2-a007-4cb8-b632-f1aba5a542a7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.213034 Aug 04 02:37:19.727258 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 60/108] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:19 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:19.839330 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:19.839940 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:19.846370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.846872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:19.847635 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:19.848237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.001187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:20.009402 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f30cf9e9-eada-49ac-95b0-1a5a948bd722 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1314 microversion: 2.1 time: 0.174034 Aug 04 02:37:20.010223 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 49/109] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:19 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:20.241086 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-fbb8ab45-e3de-4ba5-9cd5-e618bedcf335 req-5cb47fba-c881-4a2a-b680-c076b7fdd7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc200eb6-cfc2-4316-abb2-207a36281bf7", "name": "network-vif-plugged", "status": "completed", "tag": "d252568c-1f06-4cbc-bf58-fc9263892021"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:20.250833 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-fbb8ab45-e3de-4ba5-9cd5-e618bedcf335 req-5cb47fba-c881-4a2a-b680-c076b7fdd7a1 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:20.251274 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-fbb8ab45-e3de-4ba5-9cd5-e618bedcf335 req-5cb47fba-c881-4a2a-b680-c076b7fdd7a1 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.263955 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-fbb8ab45-e3de-4ba5-9cd5-e618bedcf335 req-5cb47fba-c881-4a2a-b680-c076b7fdd7a1 service nova] Creating event network-vif-plugged:d252568c-1f06-4cbc-bf58-fc9263892021 for instance bc200eb6-cfc2-4316-abb2-207a36281bf7 on hv-cinder-74014 Aug 04 02:37:20.268946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-fbb8ab45-e3de-4ba5-9cd5-e618bedcf335 req-5cb47fba-c881-4a2a-b680-c076b7fdd7a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031505 Aug 04 02:37:20.269539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 61/110] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:20.455534 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:20.455534 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:20.457065 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:20.457686 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.458792 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:20.459441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.488128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:20.489261 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:20.495412 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:20.495858 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.496626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:20.497089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.613361 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:20.622979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-dbdf7971-26ed-44df-b1c8-ee518e3eec1d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.184895 Aug 04 02:37:20.623631 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 50/111] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:20 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:20.687503 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:20.695805 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f9ec40c5-ed9c-4d6c-bc3f-7845da5918a8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.212343 Aug 04 02:37:20.696371 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 62/112] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:20 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:20.752202 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:20.752906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:20.758889 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:20.759414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.760396 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:20.761394 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:20.938097 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:20.948326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:20.951818 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:20.953643 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c91e50e5-740a-4c65-aef2-f3eb8dae334c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.205501 Aug 04 02:37:20.954166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 51/113] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:20 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:21.033791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:21.034658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:21.046760 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.047458 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:21.052669 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.053315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:21.220049 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:21.227737 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-21f110be-d185-4e9b-820f-796994ec950c tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1501 microversion: 2.1 time: 0.199154 Aug 04 02:37:21.228697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 63/114] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:21 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:21.647286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:21.647898 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:21.654706 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.655154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:21.656000 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.656443 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:21.677164 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=100 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:21.719087 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:21.720462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:21.725887 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.726336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:21.727129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.727561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:21.802740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:21.811573 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-56658530-8397-4274-9048-8a3aff242d78 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.168384 Aug 04 02:37:21.812555 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 52/115] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:21 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:21.917536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:21.940710 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7eb025b4-334d-47f7-8acc-7dd08fec0bf0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.225518 Aug 04 02:37:21.941551 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 64/116] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:21 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:21.977070 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:21.977720 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:21.984734 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.985185 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:21.985944 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:21.986414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:22.129981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:22.140184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:22.141711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:22.142876 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-89b84172-cdf3-45bf-a46d-5efe79472fba tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.169731 Aug 04 02:37:22.144143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 53/117] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:21 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:22.340209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-84ff4ab8-2f9b-48c9-95ca-e0fd511e560d req-e8d43eee-9b17-4e64-8938-85e3d9b501ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1c4809-6fd6-4207-b2e0-7b9801de9c0f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8ed6f1-6392-4077-a6da-de33241cc091"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:22.352476 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-84ff4ab8-2f9b-48c9-95ca-e0fd511e560d req-e8d43eee-9b17-4e64-8938-85e3d9b501ad service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:22.353041 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-84ff4ab8-2f9b-48c9-95ca-e0fd511e560d req-e8d43eee-9b17-4e64-8938-85e3d9b501ad service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:22.365505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-84ff4ab8-2f9b-48c9-95ca-e0fd511e560d req-e8d43eee-9b17-4e64-8938-85e3d9b501ad service nova] Creating event network-vif-plugged:0e8ed6f1-6392-4077-a6da-de33241cc091 for instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f on hv-cinder-74014 Aug 04 02:37:22.370556 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-84ff4ab8-2f9b-48c9-95ca-e0fd511e560d req-e8d43eee-9b17-4e64-8938-85e3d9b501ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 Aug 04 02:37:22.372083 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 65/118] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:22.832610 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:22.833804 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:22.844763 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:22.845509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:22.846421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:22.847016 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:22.964135 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:22.964822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:22.978113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:22.978113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:22.978113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:22.978113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:23.093437 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:23.114922 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8989a64d-c7b8-455f-80a3-48f9d77e7a6b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.286375 Aug 04 02:37:23.129627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 54/119] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:22 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:23.135125 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-32b9d664-21ee-4105-8e58-34c9d236353d tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c894243-937b-4cf8-aaf1-ce5a02d4dbd4"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:23.137971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-32b9d664-21ee-4105-8e58-34c9d236353d tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:23.144818 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-32b9d664-21ee-4105-8e58-34c9d236353d tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:23.145522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-32b9d664-21ee-4105-8e58-34c9d236353d tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:23.146516 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-32b9d664-21ee-4105-8e58-34c9d236353d tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:23.146946 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-32b9d664-21ee-4105-8e58-34c9d236353d tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:23.166052 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:23.179203 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a6b1b617-59b2-4712-813a-6be546772252 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1322 microversion: 2.1 time: 0.215791 Aug 04 02:37:23.179203 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 66/120] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:22 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:23.181525 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:23.182132 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:23.189303 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:23.190034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:23.190832 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:23.191409 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:23.352494 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:23.368065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:23.371136 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:23.374516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-65005b26-555b-40da-bd12-f7cee7d1f75d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.196503 Aug 04 02:37:23.375489 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 67/121] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:23 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:24.139462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:24.140156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:24.146530 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.147204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.147977 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.148433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.266466 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-32b9d664-21ee-4105-8e58-34c9d236353d tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "POST /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.135178 Aug 04 02:37:24.267111 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 55/122] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:37:23 2022] POST /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3/os-volume_attachments => generated 194 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:24.272521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:24.273214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:24.280966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.281798 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.282933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.283403 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.308151 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:24.328825 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-84891752-4480-4160-9885-473cf5e44df2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.192266 Aug 04 02:37:24.329459 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 68/123] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:24 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:24.393739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-aacab374-05f6-480b-b504-2bfea2f99d0f req-4fb836c3-ef3a-4696-9387-6c6db48be851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fb61ca-19be-4d4c-a340-ec997691ac10", "name": "network-vif-plugged", "status": "completed", "tag": "47529bd5-9d31-4f9f-8fd1-96a64c939a51"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:24.405258 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-aacab374-05f6-480b-b504-2bfea2f99d0f req-4fb836c3-ef3a-4696-9387-6c6db48be851 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.405808 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-aacab374-05f6-480b-b504-2bfea2f99d0f req-4fb836c3-ef3a-4696-9387-6c6db48be851 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.441281 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-aacab374-05f6-480b-b504-2bfea2f99d0f req-4fb836c3-ef3a-4696-9387-6c6db48be851 service nova] Creating event network-vif-plugged:47529bd5-9d31-4f9f-8fd1-96a64c939a51 for instance 88fb61ca-19be-4d4c-a340-ec997691ac10 on hv-cinder-74014 Aug 04 02:37:24.449584 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:24.450526 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-aacab374-05f6-480b-b504-2bfea2f99d0f req-4fb836c3-ef3a-4696-9387-6c6db48be851 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059524 Aug 04 02:37:24.456808 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 69/124] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:37:24.459034 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f8c154da-d9b9-4eb1-9cdc-34892340bdcc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1516 microversion: 2.1 time: 0.190513 Aug 04 02:37:24.459884 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 56/125] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:24 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:24.464811 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:24.466515 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:24.482095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:24.493444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.493444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.493444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.493444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.493957 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:24.493957 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.493957 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.495229 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.495864 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.521140 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lazy-loading 'flavor' on Instance uuid bc200eb6-cfc2-4316-abb2-207a36281bf7 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:37:24.671101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:24.707885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:24.709750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:24.711106 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-585e5240-9fd5-4def-9ae7-13354c1180dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.252409 Aug 04 02:37:24.712190 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 70/126] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:24 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:24.867599 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-59b9dcb9-a9c4-4e4c-a0b6-50023a798778 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7/action" status: 200 len: 32 microversion: 2.1 time: 0.390741 Aug 04 02:37:24.874627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 57/127] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:37:24 2022] POST /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 02:37:24.881105 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:24.881924 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:24.914238 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.914727 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:24.915708 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:24.916320 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:25.083143 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:25.091411 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-35e130ec-9ca1-40ce-8fc8-3bd88724fe2f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.213348 Aug 04 02:37:25.092521 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 71/128] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:24 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:25.354800 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:25.356313 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:25.374281 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:25.374888 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:25.375782 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:25.376298 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:25.645073 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:25.655962 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-79615423-9409-41fe-b279-8245db813d76 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1363 microversion: 2.1 time: 0.308107 Aug 04 02:37:25.656557 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 58/129] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:25 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:25.736058 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:25.736807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:25.746327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:25.747411 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:25.749215 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:25.750310 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:25.929803 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:25.938402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:25.940102 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:25.941291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b8045dde-598a-402f-92ff-e124579b815c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.210115 Aug 04 02:37:25.948716 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 72/130] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:25 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:26.113807 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:26.114426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:26.121223 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.121679 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.122478 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.123101 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.257507 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:26.265961 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e3ae5b01-22cf-4439-8a33-aab9630e0909 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.156219 Aug 04 02:37:26.271124 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 59/131] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:26 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:26.677696 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:26.680180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:26.686903 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.687355 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.688163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.688602 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.847109 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:26.856730 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-82bc52b8-90fe-4d23-a451-209aef06fd97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1549 microversion: 2.1 time: 0.182716 Aug 04 02:37:26.857966 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 73/132] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:26 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:26.880538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-40e70584-f8b9-4117-adc7-6374bac59ce2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:26.881206 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-40e70584-f8b9-4117-adc7-6374bac59ce2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:26.887953 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40e70584-f8b9-4117-adc7-6374bac59ce2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.888418 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40e70584-f8b9-4117-adc7-6374bac59ce2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.889290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40e70584-f8b9-4117-adc7-6374bac59ce2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.889662 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40e70584-f8b9-4117-adc7-6374bac59ce2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.965164 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:26.968217 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:26.978270 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.979584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.980624 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:26.981636 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:26.992477 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-40e70584-f8b9-4117-adc7-6374bac59ce2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117594 Aug 04 02:37:26.993245 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 60/133] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:37:26 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:27.169302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:27.178381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:27.180168 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:27.181366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7a9d394a-67ea-451f-844a-056b23e63af4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.220946 Aug 04 02:37:27.181922 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 74/134] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:26 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:27.289001 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:27.289769 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:27.296076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:27.296641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:27.304438 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:27.304905 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:27.775884 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:27.787596 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-735d2bfe-cbcf-4702-96fd-699c673e66d1 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.502733 Aug 04 02:37:27.788343 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 61/135] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:27 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:28.205026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:28.205638 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:28.211648 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:28.212091 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:28.212844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:28.213277 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:28.451780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:28.457169 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:28.459632 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:28.460767 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6cd2a583-6be6-439f-bbad-cf772850b960 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1406 microversion: 2.20 time: 0.260556 Aug 04 02:37:28.461345 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 75/136] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:28 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:37:28.811632 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:28.815655 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-5dad465e-bea5-4eb4-aa09-596524e2c2a3 req-331e2585-40d9-40e8-9cc3-0f219f3aedef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1c4809-6fd6-4207-b2e0-7b9801de9c0f", "tag": "0e8ed6f1-6392-4077-a6da-de33241cc091"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:28.818175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:28.843293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:28.843293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:28.844323 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:28.845485 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:28.850727 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5dad465e-bea5-4eb4-aa09-596524e2c2a3 req-331e2585-40d9-40e8-9cc3-0f219f3aedef service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:28.851166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5dad465e-bea5-4eb4-aa09-596524e2c2a3 req-331e2585-40d9-40e8-9cc3-0f219f3aedef service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:28.882429 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-5dad465e-bea5-4eb4-aa09-596524e2c2a3 req-331e2585-40d9-40e8-9cc3-0f219f3aedef service nova] Creating event network-changed:0e8ed6f1-6392-4077-a6da-de33241cc091 for instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f on hv-cinder-74014 Aug 04 02:37:28.899714 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-5dad465e-bea5-4eb4-aa09-596524e2c2a3 req-331e2585-40d9-40e8-9cc3-0f219f3aedef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097932 Aug 04 02:37:28.901652 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 62/137] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:29.011405 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:29.012786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:29.026389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.026389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.027502 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.029580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.082631 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:37:29.138845 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:29.142900 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=100 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:29.147431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8daf3252-2902-4cee-a67a-0f19db64d480 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.342150 Aug 04 02:37:29.149629 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 76/138] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:28 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:29.485713 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:29.486337 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:29.492517 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.492967 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.493731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.494224 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.503132 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ace5beb4-9800-409c-a62b-9794983c05c5 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 204 len: 0 microversion: 2.1 time: 0.507424 Aug 04 02:37:29.504268 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 63/139] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:37:28 2022] DELETE /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:37:29.514359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:29.515677 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:29.522899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.523419 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.524387 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.524879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.709539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:29.726290 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:29.729335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:29.732104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d0721e08-f59b-46e1-a864-da985f46ff2d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1599 microversion: 2.20 time: 0.249341 Aug 04 02:37:29.752171 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 77/140] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:37:29 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1599 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:37:29.760534 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b38d55bc-2cb0-4a94-ba77-316ddd1175e6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:29.761035 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b38d55bc-2cb0-4a94-ba77-316ddd1175e6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:29.769423 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b38d55bc-2cb0-4a94-ba77-316ddd1175e6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.770127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b38d55bc-2cb0-4a94-ba77-316ddd1175e6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.771777 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b38d55bc-2cb0-4a94-ba77-316ddd1175e6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:29.772854 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b38d55bc-2cb0-4a94-ba77-316ddd1175e6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:29.796167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:29.805905 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b9f28ada-c594-46c8-b69b-d5ff5686454b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1553 microversion: 2.1 time: 0.297204 Aug 04 02:37:29.806883 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 64/141] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:29 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:29.909402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b38d55bc-2cb0-4a94-ba77-316ddd1175e6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.154739 Aug 04 02:37:29.910081 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 78/142] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 4 02:37:29 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:37:30.175134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:30.175751 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:30.183624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:30.184833 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:30.186079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:30.186718 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:30.191663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:30.515326 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1315633932", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "networks": [{"uuid": "f89913bf-3255-4238-be55-7976e4ea1c1a"}]}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:30.586644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] validate_networks() for [('f89913bf-3255-4238-be55-7976e4ea1c1a', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:37:30.697894 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:30.715781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a59f4890-9d57-4551-b5dd-94c10014f63b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.545500 Aug 04 02:37:30.728792 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 65/143] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:30 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:30.828740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:30.829358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:30.836190 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:30.836643 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:30.842783 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:30.843321 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:31.058297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:37:31.058760 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:37:31.059751 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:37:31.060186 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:37:31.060708 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:37:31.071253 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:31.071253 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:31.071594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:31.072222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:31.091603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Getting quotas for project 9483a04c7fe24657a940a7d2c7fd6672. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:37:31.096220 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Getting quotas for user 98cd27889e354fc3b35f880927e6147f and project 9483a04c7fe24657a940a7d2c7fd6672. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:37:31.109935 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:37:31.113580 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:37:31.162580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:31.172936 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-766f5470-74c6-4c6b-97b6-ed20e60d5926 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1553 microversion: 2.1 time: 0.349186 Aug 04 02:37:31.220499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 66/144] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:30 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:31.334875 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-01ee0465-a4b3-4475-908f-18611f1c0976 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975521 Aug 04 02:37:31.336938 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 79/145] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:37:31.346723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-507730a5-b701-47b3-b7a6-d8fbf960dcab tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:31.348602 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-507730a5-b701-47b3-b7a6-d8fbf960dcab tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:31.480752 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-507730a5-b701-47b3-b7a6-d8fbf960dcab tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:31.492426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-507730a5-b701-47b3-b7a6-d8fbf960dcab tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1214 microversion: 2.1 time: 0.149238 Aug 04 02:37:31.495643 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 67/146] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:31 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:31.738776 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:31.739404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:31.756108 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:31.767887 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:31.767887 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:31.767887 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:32.114085 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:32.125830 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2751d5ca-27e2-45f7-a552-3b7e03a5f355 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.390794 Aug 04 02:37:32.140240 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 80/147] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:31 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:32.241250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:32.242295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:32.253339 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:32.256645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:32.256645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:32.256645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:32.520636 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5ed4d429-42e9-4afb-a7de-44657a630b25 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:32.523393 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5ed4d429-42e9-4afb-a7de-44657a630b25 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:32.596575 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5ed4d429-42e9-4afb-a7de-44657a630b25 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:32.604514 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5ed4d429-42e9-4afb-a7de-44657a630b25 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1214 microversion: 2.1 time: 0.087768 Aug 04 02:37:32.605089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 81/148] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:32 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:32.610323 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:32.621427 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9d70f670-2bfe-4028-ae8c-6c79d077f04e tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1553 microversion: 2.1 time: 0.384630 Aug 04 02:37:32.622913 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 68/149] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:32 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:32.686106 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-5b08c3c3-b34d-4ee2-b155-4baa468fedd2 req-923f2afb-ed04-4cf3-8a34-6da4a461f1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88fb61ca-19be-4d4c-a340-ec997691ac10", "tag": "47529bd5-9d31-4f9f-8fd1-96a64c939a51"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:32.698445 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-5b08c3c3-b34d-4ee2-b155-4baa468fedd2 req-923f2afb-ed04-4cf3-8a34-6da4a461f1de service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:32.699213 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-5b08c3c3-b34d-4ee2-b155-4baa468fedd2 req-923f2afb-ed04-4cf3-8a34-6da4a461f1de service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:32.743531 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-5b08c3c3-b34d-4ee2-b155-4baa468fedd2 req-923f2afb-ed04-4cf3-8a34-6da4a461f1de service nova] Creating event network-changed:47529bd5-9d31-4f9f-8fd1-96a64c939a51 for instance 88fb61ca-19be-4d4c-a340-ec997691ac10 on hv-cinder-74014 Aug 04 02:37:32.755146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-5b08c3c3-b34d-4ee2-b155-4baa468fedd2 req-923f2afb-ed04-4cf3-8a34-6da4a461f1de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074651 Aug 04 02:37:32.756147 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 82/150] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:33.149784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:33.150309 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:33.154979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:33.164265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:33.164926 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:33.165872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:33.167136 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:33.431586 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:33.440471 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0a34898d-469e-4a45-810d-86aaa5ef00eb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.295067 Aug 04 02:37:33.441794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 69/151] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:33 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:33.634452 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:33.643195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:33.646571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:33.650210 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:33.656082 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:33.656698 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:33.657432 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:33.658687 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:33.659325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:33.661227 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:33.662562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:33.664539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:33.819111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:33.831358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-414b2f26-caa0-4b0a-8a4c-acfbcff18390 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1210 microversion: 2.1 time: 0.208802 Aug 04 02:37:33.831358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 83/152] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:33 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1210 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:33.858435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:33.866737 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4e6e96c6-a742-4e6c-ae63-e7fc55b85523 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1345 microversion: 2.1 time: 0.224135 Aug 04 02:37:33.874547 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 70/153] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:33 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1345 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:34.465935 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:34.466662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:34.472807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.473257 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.474009 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.474437 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.605775 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:34.622083 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4e329f5f-06f8-4d7a-9248-1afc5cc72c99 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.160089 Aug 04 02:37:34.623876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 84/154] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:34 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:34.781225 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-325399ae-19b0-4b05-96d6-6a3498542486 req-266f689f-4d79-41aa-a5b1-67822197d817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4d4695-16d8-4b01-9104-7ab9728d75f3", "name": "network-vif-deleted", "tag": "ac6c1c23-eb5f-4e9a-9149-bcbf2119420a"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:34.792979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-325399ae-19b0-4b05-96d6-6a3498542486 req-266f689f-4d79-41aa-a5b1-67822197d817 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.793423 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-325399ae-19b0-4b05-96d6-6a3498542486 req-266f689f-4d79-41aa-a5b1-67822197d817 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.805301 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-325399ae-19b0-4b05-96d6-6a3498542486 req-266f689f-4d79-41aa-a5b1-67822197d817 service nova] Creating event network-vif-deleted:ac6c1c23-eb5f-4e9a-9149-bcbf2119420a for instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 on hv-cinder-74014 Aug 04 02:37:34.810479 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-325399ae-19b0-4b05-96d6-6a3498542486 req-266f689f-4d79-41aa-a5b1-67822197d817 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034184 Aug 04 02:37:34.811123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 71/155] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:37:34.852100 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:34.852742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:34.859732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.860182 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.861251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.861837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.889628 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:34.890517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:34.897011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.897928 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.899062 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.899866 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.937085 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:34.941241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:34.941906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:34.942609 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lazy-loading 'fault' on Instance uuid 8c4d4695-16d8-4b01-9104-7ab9728d75f3 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:37:34.948152 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4b8c99be-9682-4ea4-a9af-d27868d8478c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1274 microversion: 2.1 time: 0.099874 Aug 04 02:37:34.963036 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 85/156] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:34 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:35.014081 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8bc44049ca2427883806568abab2681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:35.024069 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0bd35e22-19f6-4ff3-a1cf-8c7d807faf98 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 200 len: 1350 microversion: 2.1 time: 0.139355 Aug 04 02:37:35.038946 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 72/157] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:34 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:35.647390 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:35.648001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:35.654198 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:35.654684 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:35.655448 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:35.655876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:35.801826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:35.810686 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-79c1215a-2e6d-48cc-b0d3-223ec3d2b77a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.167029 Aug 04 02:37:35.811652 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 86/158] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:35 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:35.970316 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:35.971059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:35.981463 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:35.982190 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:35.983673 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:35.984670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.048812 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:36.050057 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:36.053333 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:36.060816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:36.061521 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.062448 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:36.063068 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.090160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] HTTP exception thrown: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Request method failure captured: Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 HTTP/1.1 Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zC6FF_9Xem4honxI6EXiXyXCkZpmjGa_Y4W9vdxKRObt0_e4IeqEJE-90uZTLzjs45BSkjv4FD3NhjXrrEghaqFTX6zAD9XUG7GsyTr7qBzteRRjekuJTYFXkG6tCgSA-cyUT49O3T9uiwmK098LN0jJgT4rmKNahOV73X9PDwXNnA Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:37:36.100678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: d8bc44049ca2427883806568abab2681 Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.105956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '8c4d4695-16d8-4b01-9104-7ab9728d75f3'} Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:37:36.106844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.108017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.109086 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Returning 404 to user: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:37:36.109086 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5f62dbe5-43e7-4ba8-86da-69524a38622b tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 404 len: 111 microversion: 2.1 time: 0.058448 Aug 04 02:37:36.109086 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 87/159] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:36 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:37:36.233146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:36.238027 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:36.241389 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:36.241910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.242770 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:36.243335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.256480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] HTTP exception thrown: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Request method failure captured: Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3/os-volume_attachments HTTP/1.1 Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zC6FF_9Xem4honxI6EXiXyXCkZpmjGa_Y4W9vdxKRObt0_e4IeqEJE-90uZTLzjs45BSkjv4FD3NhjXrrEghaqFTX6zAD9XUG7GsyTr7qBzteRRjekuJTYFXkG6tCgSA-cyUT49O3T9uiwmK098LN0jJgT4rmKNahOV73X9PDwXNnA Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:37:36.258327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: d8bc44049ca2427883806568abab2681 Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.259635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'server_id': '8c4d4695-16d8-4b01-9104-7ab9728d75f3'} Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:37:36.260787 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:36.261925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:36.263179 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Returning 404 to user: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:37:36.263179 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-18e57b51-be5a-466d-b0c5-2b8cc08e10b6 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031327 Aug 04 02:37:36.263179 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 88/160] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:37:36 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:37:36.263356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:36.270750 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-12325989-be93-47c5-b98b-68172afa0cd1 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.305049 Aug 04 02:37:36.271457 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 73/161] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:35 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:36.832302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:36.832943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:36.839167 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:36.839609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.841046 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:36.841489 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.903915 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-8f3fcf35-d42e-4793-9094-7ceeaffeb5c7 req-6fd36202-4b54-4a5b-9f76-4e02365bb83d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9901fb04-2777-4556-a37c-6f8c30373d79", "tag": "23a0e1d3-71c4-4689-bacd-e43996984297"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:36.926932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8f3fcf35-d42e-4793-9094-7ceeaffeb5c7 req-6fd36202-4b54-4a5b-9f76-4e02365bb83d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:36.932955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8f3fcf35-d42e-4793-9094-7ceeaffeb5c7 req-6fd36202-4b54-4a5b-9f76-4e02365bb83d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:36.950978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-8f3fcf35-d42e-4793-9094-7ceeaffeb5c7 req-6fd36202-4b54-4a5b-9f76-4e02365bb83d service nova] Creating event network-changed:23a0e1d3-71c4-4689-bacd-e43996984297 for instance 9901fb04-2777-4556-a37c-6f8c30373d79 on hv-cinder-74014 Aug 04 02:37:36.959805 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-8f3fcf35-d42e-4793-9094-7ceeaffeb5c7 req-6fd36202-4b54-4a5b-9f76-4e02365bb83d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058985 Aug 04 02:37:36.960804 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 74/162] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:37.037255 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:37.046525 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3795168d-d104-4572-b4f9-da1799b2053b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.218780 Aug 04 02:37:37.047026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 89/163] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:36 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:37.296360 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:37.297344 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:37.324754 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:37.325231 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:37.326475 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:37.326932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:37.552330 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:37.561057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-83783ff5-8014-4c0f-9574-e3dec9865b57 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.271338 Aug 04 02:37:37.561644 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 75/164] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:37 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:37.806003 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:37.806648 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:37.813755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:37.814286 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:37.815294 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:37.815983 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:37.830804 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] HTTP exception thrown: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Request method failure captured: Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: DELETE /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 HTTP/1.1 Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zC6FF_9Xem4honxI6EXiXyXCkZpmjGa_Y4W9vdxKRObt0_e4IeqEJE-90uZTLzjs45BSkjv4FD3NhjXrrEghaqFTX6zAD9XUG7GsyTr7qBzteRRjekuJTYFXkG6tCgSA-cyUT49O3T9uiwmK098LN0jJgT4rmKNahOV73X9PDwXNnA Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:37:37.832351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: d8bc44049ca2427883806568abab2681 Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.833802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '8c4d4695-16d8-4b01-9104-7ab9728d75f3'} Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:37:37.834559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.835779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.837090 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Returning 404 to user: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:37:37.837090 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-891a41a7-cf78-4115-8538-7b30a99db72f tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 404 len: 111 microversion: 2.1 time: 0.032700 Aug 04 02:37:37.837090 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 90/165] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:37:37 2022] DELETE /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:37:37.842354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:37.843060 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] [instance: 8c4d4695-16d8-4b01-9104-7ab9728d75f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:37.849012 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:37.849469 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:37.850234 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:37.850721 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:37.867220 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] HTTP exception thrown: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Request method failure captured: Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 HTTP/1.1 Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zC6FF_9Xem4honxI6EXiXyXCkZpmjGa_Y4W9vdxKRObt0_e4IeqEJE-90uZTLzjs45BSkjv4FD3NhjXrrEghaqFTX6zAD9XUG7GsyTr7qBzteRRjekuJTYFXkG6tCgSA-cyUT49O3T9uiwmK098LN0jJgT4rmKNahOV73X9PDwXNnA Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:37:37.872413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b0b8e8bfa74696bea98b9aa0f19951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: a9b0b8e8bfa74696bea98b9aa0f19951 Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-DeleteServersTestJSON-1370231852 Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: d8bc44049ca2427883806568abab2681 Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-DeleteServersTestJSON-1370231852-project Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.874147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '8c4d4695-16d8-4b01-9104-7ab9728d75f3'} Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:37:37.875193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. Aug 04 02:37:37.876267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:37.877354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] Returning 404 to user: Instance 8c4d4695-16d8-4b01-9104-7ab9728d75f3 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:37:37.877354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-039602ce-b6de-4ec5-bae2-878652ce3fc2 tempest-DeleteServersTestJSON-1370231852 tempest-DeleteServersTestJSON-1370231852-project] 10.222.0.60 "GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3" status: 404 len: 111 microversion: 2.1 time: 0.035384 Aug 04 02:37:37.877354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 76/166] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:37 2022] GET /compute/v2.1/servers/8c4d4695-16d8-4b01-9104-7ab9728d75f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:37:38.067959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:38.068728 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:38.074783 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:38.075405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:38.076139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:38.076570 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:38.583383 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:38.584569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:38.592940 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:38.594014 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:38.595163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:38.595934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:38.598898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:38.640426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8a1f8dde-adea-47e9-ad54-b67b85a2cfc5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.569478 Aug 04 02:37:38.647888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 91/167] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:38 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:38.756836 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:38.765361 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-cf4ad617-f4e7-486e-a70e-4d335380f498 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.186419 Aug 04 02:37:38.766008 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 77/168] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:38 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:39.661417 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:39.662131 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:39.669321 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:39.673942 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:39.679191 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:39.679191 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:39.787983 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:39.788820 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:39.795824 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:39.796263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:39.797103 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:39.797449 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:39.902800 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:39.923440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-cd93312f-1bb8-440f-a667-f7ec7c4282b4 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.265867 Aug 04 02:37:39.924560 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 92/169] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:39 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:40.109084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:40.120203 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-53e95ee0-cfb5-4b31-bd25-4a36bc5cdf66 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.336349 Aug 04 02:37:40.121279 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 78/170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:39 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:40.944695 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:40.954594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:40.961342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:40.961796 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:40.962593 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:40.965186 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:41.082565 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:41.197300 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:41.197300 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7239d3e9-fc95-4fde-8014-fcffc0ac7e52 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.200566 Aug 04 02:37:41.197300 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 93/171] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:40 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:41.198076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:41.198076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:41.198076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:41.198076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:41.198896 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:41.198896 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:41.337058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:41.353084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-477af660-7617-4e26-8b85-1cd85e5d698c tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.212328 Aug 04 02:37:41.354173 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 79/172] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:41 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:42.203181 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:42.203938 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:42.210596 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:42.211130 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:42.211999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:42.212508 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:42.376770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:42.378685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:42.383901 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:42.386556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:42.387139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:42.389550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:42.390078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:42.466779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:42.477492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-06002e36-1cc9-4d63-83fd-c8ab9825ec7c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.278205 Aug 04 02:37:42.479826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 94/173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:42 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:42.558653 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:42.566186 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d8885338-b726-4981-8aba-f85383655cf3 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.195527 Aug 04 02:37:42.566822 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 80/174] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:42 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:43.500894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:43.501507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:43.503426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=8 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:43.508367 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:43.508935 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:43.509925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:43.510453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:43.588566 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:43.588566 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:43.595534 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:43.595973 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:43.596904 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:43.597331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:43.712700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:43.723788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-812efce2-e6c2-4cda-bfab-1cb0d4a18393 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.227280 Aug 04 02:37:43.732244 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 95/175] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:43 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:43.831795 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:43.842317 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2eae58b8-ad26-41c8-bd26-d12d73bc7316 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.259103 Aug 04 02:37:43.842960 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 81/176] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:43 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:43.873441 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-7e438c68-9ec7-4ae9-a344-6631cb392947 req-544ebdfb-be3b-4a12-b07a-624ba1a1866e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9901fb04-2777-4556-a37c-6f8c30373d79", "name": "network-vif-plugged", "status": "completed", "tag": "23a0e1d3-71c4-4689-bacd-e43996984297"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:43.883557 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-7e438c68-9ec7-4ae9-a344-6631cb392947 req-544ebdfb-be3b-4a12-b07a-624ba1a1866e service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:43.884002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-7e438c68-9ec7-4ae9-a344-6631cb392947 req-544ebdfb-be3b-4a12-b07a-624ba1a1866e service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:43.895726 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-7e438c68-9ec7-4ae9-a344-6631cb392947 req-544ebdfb-be3b-4a12-b07a-624ba1a1866e service nova] Creating event network-vif-plugged:23a0e1d3-71c4-4689-bacd-e43996984297 for instance 9901fb04-2777-4556-a37c-6f8c30373d79 on hv-cinder-74014 Aug 04 02:37:43.901087 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-7e438c68-9ec7-4ae9-a344-6631cb392947 req-544ebdfb-be3b-4a12-b07a-624ba1a1866e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032208 Aug 04 02:37:43.902700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 96/177] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:37:44.752513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:44.753195 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:44.760531 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:44.761185 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:44.761983 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:44.762813 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:44.864816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:44.866064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:44.893549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:44.893549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:44.893549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:44.893549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:44.945670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:44.956217 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-53144e65-181d-4a0a-8317-83175b118d78 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.211256 Aug 04 02:37:44.957257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 82/178] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:44 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:45.064234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:45.072512 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-14f4830c-3615-4046-ad1a-2b3f2169c5f0 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1314 microversion: 2.1 time: 0.212193 Aug 04 02:37:45.073084 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 97/179] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:44 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:45.977522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:45.978134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:45.984700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:45.985149 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:45.985913 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:45.986348 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:46.093532 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:46.095999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:46.101164 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:46.101616 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:46.102378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:46.102967 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:46.143658 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:46.153524 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-94db3ddf-3be9-4d4a-85df-bfade56679a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.179776 Aug 04 02:37:46.154535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 83/180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:45 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:46.252573 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:46.256302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=100 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:46.263282 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-93f30777-643b-431c-b408-5506a8f68998 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1497 microversion: 2.1 time: 0.171846 Aug 04 02:37:46.263282 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 98/181] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:46 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:47.186949 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:47.186949 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:47.193073 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:47.194563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:47.196143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:47.196741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:47.216969 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=100 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:47.337926 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:47.346063 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0de3663a-9f09-446b-9cc2-2cc34db3f2d2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.167271 Aug 04 02:37:47.346668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 84/182] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:47 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:48.371697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:48.372325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:48.379732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:48.380177 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:48.381849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:48.382510 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:48.514732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:48.522458 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bf3abf8b-5b36-4674-bcb1-fa4682dd8a28 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.154749 Aug 04 02:37:48.523040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 99/183] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:48 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:49.545456 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:49.546144 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:49.556552 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:49.557742 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:49.562716 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:49.564004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:49.775087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:49.790413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-28f4930e-123e-471a-b211-31b43f431a3d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.246374 Aug 04 02:37:49.790413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 85/184] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:49 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:49.893046 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:49.893656 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:49.901702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:49.901702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:49.901702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:49.901702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:49.931959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:37:50.274718 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9b54e227-6edc-4011-a936-f06e915143c2 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 204 len: 0 microversion: 2.1 time: 0.387455 Aug 04 02:37:50.275576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 100/185] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:37:49 2022] DELETE /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:37:50.283982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:50.284577 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:50.290531 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:50.290979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:50.291734 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:50.292162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:50.445099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:50.453493 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-458a24c0-39e6-4b2e-8742-28eefe3d1fcf tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1503 microversion: 2.1 time: 0.172997 Aug 04 02:37:50.453757 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 86/186] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:50 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:37:50.810920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:50.811628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:50.818402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:50.818893 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:50.819664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:50.820135 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:50.971333 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:50.980554 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-67c619c9-5129-4375-8002-bc8479c319c5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.174459 Aug 04 02:37:50.981732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 101/187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:50 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:51.475024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:51.475741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:51.482558 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:51.483021 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:51.483946 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:51.484461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:51.675934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:51.684945 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0cc4cc2c-8563-48ca-9ad5-5b47bce2eb11 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1503 microversion: 2.1 time: 0.213830 Aug 04 02:37:51.685538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 87/188] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:51 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:52.003314 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:52.005729 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:52.010585 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:52.011035 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:52.011804 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:52.012239 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:52.197257 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:52.206752 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1ddb9a62-aa13-4199-8168-9162ed4daf4e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.207759 Aug 04 02:37:52.207342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 102/189] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:51 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:52.710292 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:52.711060 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:52.720872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:52.723561 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:52.725469 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:52.727831 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:53.005502 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:53.014622 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9cf0a33e-32a6-4b78-b992-0e9fb1861005 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1503 microversion: 2.1 time: 0.308747 Aug 04 02:37:53.015841 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 88/190] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:52 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:53.044174 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-96e4116a-5576-4d66-888a-aae6086f22ae req-5773982e-ad03-46ad-b177-6fcbd2df7d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9901fb04-2777-4556-a37c-6f8c30373d79", "name": "network-vif-deleted", "tag": "23a0e1d3-71c4-4689-bacd-e43996984297"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:53.104254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-96e4116a-5576-4d66-888a-aae6086f22ae req-5773982e-ad03-46ad-b177-6fcbd2df7d6f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:53.107813 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-96e4116a-5576-4d66-888a-aae6086f22ae req-5773982e-ad03-46ad-b177-6fcbd2df7d6f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:53.156607 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-96e4116a-5576-4d66-888a-aae6086f22ae req-5773982e-ad03-46ad-b177-6fcbd2df7d6f service nova] Creating event network-vif-deleted:23a0e1d3-71c4-4689-bacd-e43996984297 for instance 9901fb04-2777-4556-a37c-6f8c30373d79 on hv-cinder-74014 Aug 04 02:37:53.164968 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-96e4116a-5576-4d66-888a-aae6086f22ae req-5773982e-ad03-46ad-b177-6fcbd2df7d6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124868 Aug 04 02:37:53.165981 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 103/191] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:37:53.229283 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:53.230201 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:53.237051 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:53.237589 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:53.238456 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:53.238989 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:53.393448 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:53.401633 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b0cc7d35-683a-40eb-bf24-85910c99a204 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.176817 Aug 04 02:37:53.402834 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 89/192] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:53 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:54.037413 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:54.042171 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:54.071089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:54.071723 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:54.076385 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:54.076773 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:54.158200 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:54.168369 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7f2ad5ad-ea20-4a61-be1c-09803def8efb tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1299 microversion: 2.1 time: 0.135334 Aug 04 02:37:54.177141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 104/193] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:54 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:54.423249 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:54.425428 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:54.430663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:54.431115 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:54.432008 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:54.432453 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:54.571082 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:54.579626 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ead33667-529b-4563-b4c3-b7733d889094 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1522 microversion: 2.1 time: 0.160517 Aug 04 02:37:54.580225 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 90/194] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:54 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:55.190974 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:55.191947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:55.204532 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:55.206228 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:55.207946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:55.208699 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:55.244913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:55.245457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:55.245994 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lazy-loading 'fault' on Instance uuid 9901fb04-2777-4556-a37c-6f8c30373d79 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:37:55.296786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd27889e354fc3b35f880927e6147f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483a04c7fe24657a940a7d2c7fd6672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:55.303126 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3f85dad7-e829-4024-a90e-3c7ef2dd978e tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 200 len: 1304 microversion: 2.1 time: 0.117255 Aug 04 02:37:55.303882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 105/195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:55 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:55.601215 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:55.601951 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:55.608601 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:55.616189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:55.616189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:55.616189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:55.768602 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:55.777835 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d0f770f1-2ca7-4758-a83d-82f469c09e16 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1502 microversion: 2.1 time: 0.180053 Aug 04 02:37:55.779380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 91/196] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:55 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:55.800532 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:55.811836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:55.811836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:55.811836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:55.811836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:55.812246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:55.970199 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:55.977868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-65c1ccc1-e6af-42f2-807f-924ea313db1a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1515 microversion: 2.1 time: 0.181487 Aug 04 02:37:55.978433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 106/197] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:55 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:37:56.324632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:56.326324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] [instance: 9901fb04-2777-4556-a37c-6f8c30373d79] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:56.332497 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:56.338046 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:56.338046 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:56.338046 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:56.348021 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] HTTP exception thrown: Instance 9901fb04-2777-4556-a37c-6f8c30373d79 could not be found. Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Request method failure captured: Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 HTTP/1.1 Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDnNekYa4Lgj9JtHQavPrfn_lKsgF84UAodKk4KW7Kpc07IQDUTuv1aa_pent8aeum3SuMN1hLbxqKF4hvGuhzD03WNXHoOEHglHKl4vql-dyS6xafnLEGwmu0TTzTE-h6Vyyi_C87UJ_-aj8C160YiRB59eySEGdqyYk9-QAsuc-A Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 9483a04c7fe24657a940a7d2c7fd6672 Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesActionsTest-1872390398 Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:37:56.349530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9483a04c7fe24657a940a7d2c7fd6672"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9483a04c7fe24657a940a7d2c7fd6672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9483a04c7fe24657a940a7d2c7fd6672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9483a04c7fe24657a940a7d2c7fd6672"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesActionsTest-1872390398 Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 9483a04c7fe24657a940a7d2c7fd6672 Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesActionsTest-1872390398 Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesActionsTest-1872390398-project Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 98cd27889e354fc3b35f880927e6147f Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesActionsTest-1872390398-project Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 9901fb04-2777-4556-a37c-6f8c30373d79 could not be found. Aug 04 02:37:56.351077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '9901fb04-2777-4556-a37c-6f8c30373d79'} Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9901fb04-2777-4556-a37c-6f8c30373d79 could not be found. Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:37:56.351907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9901fb04-2777-4556-a37c-6f8c30373d79 could not be found. Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9901fb04-2777-4556-a37c-6f8c30373d79 could not be found. Aug 04 02:37:56.353354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:37:56.354618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] Returning 404 to user: Instance 9901fb04-2777-4556-a37c-6f8c30373d79 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:37:56.354618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e04063fb-f016-4d9c-9bb3-c936644657e6 tempest-VolumesActionsTest-1872390398 tempest-VolumesActionsTest-1872390398-project] 10.222.0.60 "GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79" status: 404 len: 111 microversion: 2.1 time: 0.030247 Aug 04 02:37:56.354618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 92/198] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:56 2022] GET /compute/v2.1/servers/9901fb04-2777-4556-a37c-6f8c30373d79 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:37:58.539629 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:37:58.542146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:58.548232 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:58.548691 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:58.549459 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:58.549899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:58.577059 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lazy-loading 'flavor' on Instance uuid 21754572-a17a-4c62-9a46-d59d25ba3e8c {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:37:58.908378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b45e852b-9639-4cd3-80bd-1498e3fa7f30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c/action" status: 200 len: 32 microversion: 2.1 time: 0.372700 Aug 04 02:37:58.909017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 107/199] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:37:58 2022] POST /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c/action => generated 32 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:37:58.920618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:37:58.921230 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:37:58.927881 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:58.928337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:58.929225 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:37:58.929733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:37:59.106053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:37:59.114066 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c45170d9-2500-4a73-9e12-9de5cc3a91c0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.199347 Aug 04 02:37:59.114681 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 93/200] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:37:58 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:00.135906 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:00.136608 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:00.143509 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:00.143957 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:00.144969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:00.145407 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:00.284023 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:00.291998 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-81dfc41a-7753-4856-a43c-ba66ab58cf49 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.160411 Aug 04 02:38:00.292629 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 108/201] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:00 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:01.313903 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:01.314534 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:01.321010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:01.321461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:01.322291 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:01.322764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:01.469797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:01.473137 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-216a7d64-cae2-464e-8c50-6a928694ea6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.163784 Aug 04 02:38:01.487556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 94/202] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:01 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:02.494375 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:02.495243 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:02.502066 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:02.502676 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:02.503571 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:02.504112 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:02.654997 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:02.663007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-725d1e0f-2c99-4629-8e3b-d69f927af444 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.172516 Aug 04 02:38:02.663584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 109/203] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:02 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:03.688393 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:03.692761 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:03.701177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:03.702073 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:03.703648 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:03.704332 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:03.892869 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:03.902715 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0181a80c-d794-4a49-9792-9274d079bfe2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.220304 Aug 04 02:38:03.903656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 95/204] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:03 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:04.924461 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:04.925071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:04.931811 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:04.932258 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:04.933073 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:04.933650 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:05.100933 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:05.111926 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8d3f3f64-a80c-4dcf-89ca-7443507b5d31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.190370 Aug 04 02:38:05.111926 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 110/205] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:04 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:06.133101 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:06.134382 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:06.140496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=55 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:06.143329 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:06.144170 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:06.145054 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:06.145746 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:06.343129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:06.351245 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2347276c-9583-49dc-8a74-07204f46226a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.221385 Aug 04 02:38:06.351353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 96/206] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:06 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:07.373013 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:07.373617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:07.380036 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:07.380478 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:07.381232 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:07.381662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:07.570730 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:07.579332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a474abe6-fcbb-4382-b038-8aacdf138c20 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.211038 Aug 04 02:38:07.579968 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 111/207] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:07 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:08.606793 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:08.607870 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:08.626539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:08.626539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:08.626539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:08.626539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:08.869198 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:08.884357 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7187e899-8566-4309-8a29-877fdc9cc8a0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.285262 Aug 04 02:38:08.897033 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 97/208] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:08 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:09.908049 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:09.908665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:09.914384 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:09.916337 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:09.916796 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:09.917563 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:09.918187 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:09.924504 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:10.072502 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:10.080845 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-72c54ea3-5f42-489c-9174-c1be9a5baa79 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.176746 Aug 04 02:38:10.081424 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 112/209] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:09 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:11.120300 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:11.121458 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:11.132388 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:11.133156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:11.134366 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:11.135131 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:11.300923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:11.308694 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4b1becb3-ebd5-4638-a5af-ed5b57b50e63 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.195964 Aug 04 02:38:11.310050 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 98/210] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:11 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:11.921196 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-769088073", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "networks": [{"uuid": "17169483-5d92-4e45-8b4b-9e66386546d3"}]}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:11.987160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] validate_networks() for [('17169483-5d92-4e45-8b4b-9e66386546d3', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:38:12.332684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:12.333582 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:12.340180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.340751 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.341594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.342016 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.373017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:38:12.373534 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:38:12.374094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:38:12.374592 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:38:12.375363 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:38:12.385028 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.385634 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.386440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.386908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.404825 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Getting quotas for project 1be664f3b7f144268f3e4e4835f16cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:38:12.408973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Getting quotas for user 8670ec72824549f28b6530a758cbbb01 and project 1be664f3b7f144268f3e4e4835f16cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:38:12.421346 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:38:12.423670 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:38:12.481814 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:12.490242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9eb285f5-1bd4-4b61-94ce-eabf467d916d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1501 microversion: 2.1 time: 0.162068 Aug 04 02:38:12.490859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 99/211] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:12 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:12.514656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6f3a9e-a5c2-4855-b5a5-6f83aa6e2c0e"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:12.514656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:12.519498 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.519939 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.520690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.521117 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.545532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] HTTP exception thrown: Cannot 'attach_volume' instance 21754572-a17a-4c62-9a46-d59d25ba3e8c while it is in vm_state rescued Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Request method failure captured: Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: POST /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c/os-volume_attachments HTTP/1.1 Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 74 Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDAI5xZasBc4s9WNuv-Qjf7mITTZ5lofTJ84BXtJolx_So_G1w3wwpOMpl3Ud6-qvV-S0_XwYZPQQkDLIuw3gL_ck-uTgi-lNyYs9qCsxkLmyFSwSjjnLuIMcxj6MZ_bexxe72bIS1t_rK_UW24TwWGL1CWugMmQZ3f2Dqaf-0OGJ8 Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:38:12.547513 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_651f296b94d342488b3cd98998a08e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/651f296b94d342488b3cd98998a08e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 2e47969dca184aec92e620fcd53d6a5c Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {"volumeAttachment": {"volumeId": "4c6f3a9e-a5c2-4855-b5a5-6f83aa6e2c0e"}} Aug 04 02:38:12.549010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Cannot 'attach_volume' instance 21754572-a17a-4c62-9a46-d59d25ba3e8c while it is in vm_state rescued Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'server_id': '21754572-a17a-4c62-9a46-d59d25ba3e8c', 'body': {'volumeAttachment': {'volumeId': '4c6f3a9e-a5c2-4855-b5a5-6f83aa6e2c0e'}}} Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 21754572-a17a-4c62-9a46-d59d25ba3e8c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:38:12.549906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 21754572-a17a-4c62-9a46-d59d25ba3e8c while it is in vm_state rescued Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:38:12.551324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:38:12.552762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:38:12.552762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:38:12.552762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 21754572-a17a-4c62-9a46-d59d25ba3e8c while it is in vm_state rescued Aug 04 02:38:12.552762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:12.552762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Returning 409 to user: Cannot 'attach_volume' instance 21754572-a17a-4c62-9a46-d59d25ba3e8c while it is in vm_state rescued {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:38:12.552762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c6c8b934-db9e-4d46-a6d7-c3175b5ebba3 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041818 Aug 04 02:38:12.552762 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 100/212] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:38:12 2022] POST /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 02:38:12.567444 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-206c7807-ab79-4f21-889c-e52f1ec9d244 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:12.567965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-206c7807-ab79-4f21-889c-e52f1ec9d244 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:12.571492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-68f2dcbb-bb04-47cc-888d-b27815688c82 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654968 Aug 04 02:38:12.572142 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 113/213] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 02:38:12.574306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-206c7807-ab79-4f21-889c-e52f1ec9d244 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.574789 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-206c7807-ab79-4f21-889c-e52f1ec9d244 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.575705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-206c7807-ab79-4f21-889c-e52f1ec9d244 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.576136 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-206c7807-ab79-4f21-889c-e52f1ec9d244 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.583421 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4d3f6050-8f70-4eaf-a0e7-56cb4385014a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:12.587121 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4d3f6050-8f70-4eaf-a0e7-56cb4385014a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:12.619556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=100 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:12.666934 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4d3f6050-8f70-4eaf-a0e7-56cb4385014a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:12.687197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4d3f6050-8f70-4eaf-a0e7-56cb4385014a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1213 microversion: 2.1 time: 0.096053 Aug 04 02:38:12.687197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 114/214] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:12 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:12.828249 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-206c7807-ab79-4f21-889c-e52f1ec9d244 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.252683 Aug 04 02:38:12.828249 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 101/215] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:38:12 2022] POST /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:38:12.834081 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:12.835305 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:12.850619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.855226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:12.855226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:12.855226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:13.040542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:13.050084 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b455c529-6a2c-4831-9955-7b0745c1a8f6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1509 microversion: 2.1 time: 0.220239 Aug 04 02:38:13.050801 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 115/216] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:12 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:13.699805 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-525ee52a-cb29-4df9-a2b7-a4256e8c9de6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:13.700553 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-525ee52a-cb29-4df9-a2b7-a4256e8c9de6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:13.754784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-525ee52a-cb29-4df9-a2b7-a4256e8c9de6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:13.761688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-525ee52a-cb29-4df9-a2b7-a4256e8c9de6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1213 microversion: 2.1 time: 0.066597 Aug 04 02:38:13.762254 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 102/217] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:13 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:14.072465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:14.073058 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:14.079943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:14.080394 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:14.081160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:14.081617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:14.223051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:14.230448 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ce21b8e4-94da-4548-9a1e-c8995c67c45d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1509 microversion: 2.1 time: 0.162455 Aug 04 02:38:14.231251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 116/218] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:14 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:14.782632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:14.783971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:14.792003 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:14.792589 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:14.793431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:14.794741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:14.865553 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:14.874270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-05bca1db-bef2-4ec1-a762-a8021be946e5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1217 microversion: 2.1 time: 0.095825 Aug 04 02:38:14.874880 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 103/219] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:14 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:15.250772 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:15.251563 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:15.257581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:15.258026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:15.258806 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:15.259235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:15.398110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:15.407318 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ddaf14b4-b5f6-45e4-8f1b-34c0da4f31ab tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1515 microversion: 2.1 time: 0.160622 Aug 04 02:38:15.408155 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 117/220] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:15 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:15.894265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:15.894945 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:15.902077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:15.902802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:15.904217 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:15.904842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:15.987376 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:15.995247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7bcc4b85-3dd7-404b-b2fa-bcde0b7a6ab1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1265 microversion: 2.1 time: 0.104763 Aug 04 02:38:15.995853 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 104/221] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:15 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:16.070283 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9f62421f-e0f4-4382-8483-a3972ce37ff2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:16.070999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9f62421f-e0f4-4382-8483-a3972ce37ff2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:16.079247 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9f62421f-e0f4-4382-8483-a3972ce37ff2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:16.083707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9f62421f-e0f4-4382-8483-a3972ce37ff2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:16.083707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9f62421f-e0f4-4382-8483-a3972ce37ff2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:16.083707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9f62421f-e0f4-4382-8483-a3972ce37ff2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:16.107620 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9f62421f-e0f4-4382-8483-a3972ce37ff2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/ips" status: 200 len: 145 microversion: 2.1 time: 0.041874 Aug 04 02:38:16.108210 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 118/222] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:38:16 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:17.022385 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:17.023608 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:17.061441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:17.061986 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:17.062852 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:17.064660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:17.134254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-20652c25-0d47-4b6a-904d-4ae533dca4cc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'create', calling method: .version_select at 0x7fa64649aaf0>, body: {"keypair": {"name": "tempest-keypair-1430516772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnncQQp+omVuLIBazLk4a9g6rimDEqyEd3RnzEAeYA54v+zZ/3tUxaIVdNnRzSB/7M1aH1/haynJvm56dbtgq1fHf+GRYYQTSqAAyaLhRaH9AtAGSE6Ju1dzESNvshOrA=="}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:17.157443 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:17.169839 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-20652c25-0d47-4b6a-904d-4ae533dca4cc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for project 651f296b94d342488b3cd98998a08e02. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:38:17.179314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e8f9c0d1-c44b-474c-a87e-5e884aaaeab4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1271 microversion: 2.1 time: 0.160828 Aug 04 02:38:17.180745 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 105/223] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:17 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:17.181255 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-20652c25-0d47-4b6a-904d-4ae533dca4cc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for user 2e47969dca184aec92e620fcd53d6a5c and project 651f296b94d342488b3cd98998a08e02. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:38:17.282868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-20652c25-0d47-4b6a-904d-4ae533dca4cc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152408 Aug 04 02:38:17.288451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 119/224] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:38:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:18.207269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:18.209548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:18.234641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:18.235674 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:18.237347 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:18.237923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:18.449141 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:18.470047 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c88bb402-677f-45b4-aca8-4b173844e109 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.270855 Aug 04 02:38:18.471071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 106/225] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:18 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:19.324154 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-32ecdce4-9378-4115-840d-e932a1fb6e2e req-98bd7a74-7659-4cef-ac03-9150fbebceae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd88da7-d1d5-49de-8b65-01f03912727a", "tag": "31dc8216-1981-4a7d-9474-b81ad92a50d6"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:19.340692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-32ecdce4-9378-4115-840d-e932a1fb6e2e req-98bd7a74-7659-4cef-ac03-9150fbebceae service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:19.340692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-32ecdce4-9378-4115-840d-e932a1fb6e2e req-98bd7a74-7659-4cef-ac03-9150fbebceae service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:19.359952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-32ecdce4-9378-4115-840d-e932a1fb6e2e req-98bd7a74-7659-4cef-ac03-9150fbebceae service nova] Creating event network-changed:31dc8216-1981-4a7d-9474-b81ad92a50d6 for instance 4dd88da7-d1d5-49de-8b65-01f03912727a on hv-cinder-74014 Aug 04 02:38:19.364920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-32ecdce4-9378-4115-840d-e932a1fb6e2e req-98bd7a74-7659-4cef-ac03-9150fbebceae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044491 Aug 04 02:38:19.365864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 120/226] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:19.492315 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:19.492876 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:19.513966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:19.514752 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:19.518121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:19.518921 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:19.856730 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:19.864343 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-11fd7b42-cf35-49af-8b89-e7412f0537e6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.376672 Aug 04 02:38:19.865118 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 107/227] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:19 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:19.897048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b4b6ce3f-770f-4bab-9e6d-a1081f12759c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:19.897628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b4b6ce3f-770f-4bab-9e6d-a1081f12759c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:19.905535 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b4b6ce3f-770f-4bab-9e6d-a1081f12759c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:19.906157 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b4b6ce3f-770f-4bab-9e6d-a1081f12759c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:19.906967 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b4b6ce3f-770f-4bab-9e6d-a1081f12759c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:19.907399 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b4b6ce3f-770f-4bab-9e6d-a1081f12759c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:19.930900 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b4b6ce3f-770f-4bab-9e6d-a1081f12759c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/ips" status: 200 len: 153 microversion: 2.20 time: 0.037964 Aug 04 02:38:19.931485 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 121/228] 10.222.0.60 () {60 vars in 1289 bytes} [Thu Aug 4 02:38:19 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:38:20.706506 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d39a98b5-9b16-4db2-b70d-782b936c83a2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb829079-fa47-4fb0-9c2a-7e66b6f3cac7"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:20.709944 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d39a98b5-9b16-4db2-b70d-782b936c83a2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:20.717276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d39a98b5-9b16-4db2-b70d-782b936c83a2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:20.718067 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d39a98b5-9b16-4db2-b70d-782b936c83a2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:20.719216 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d39a98b5-9b16-4db2-b70d-782b936c83a2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:20.719873 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d39a98b5-9b16-4db2-b70d-782b936c83a2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:20.885434 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:20.887885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:20.895471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:20.899177 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:20.899177 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:20.899177 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:21.057378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:21.065213 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-19ea543a-1cc7-4c59-ae8e-6be17e2d6468 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.183846 Aug 04 02:38:21.079908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 122/229] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:20 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:21.182114 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-891998486", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1df2c8e-b546-495f-a797-ab719b92ef3e"}], "security_groups": [{"name": "tempest-securitygroup--379627626"}], "key_name": "tempest-keypair-1430516772", "user_data": "}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:21.312679 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] validate_networks() for [('a1df2c8e-b546-495f-a797-ab719b92ef3e', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:38:21.862296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:38:21.862753 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:38:21.865180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:38:21.865180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:38:21.865180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:38:21.875759 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:21.876570 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:21.877729 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:21.878315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:21.897599 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for project 651f296b94d342488b3cd98998a08e02. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:38:21.901739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Getting quotas for user 2e47969dca184aec92e620fcd53d6a5c and project 651f296b94d342488b3cd98998a08e02. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:38:21.915774 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:38:21.918328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:38:22.066597 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c5ebda45-89b5-40c2-8919-31b996542d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.884093 Aug 04 02:38:22.069798 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 123/230] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:38:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:38:22.076163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ffeafeb0-a0cb-4dbb-8be5-18d93accc868 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:22.076749 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ffeafeb0-a0cb-4dbb-8be5-18d93accc868 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:22.140488 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ffeafeb0-a0cb-4dbb-8be5-18d93accc868 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:22.170122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ffeafeb0-a0cb-4dbb-8be5-18d93accc868 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1245 microversion: 2.1 time: 0.081031 Aug 04 02:38:22.170122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 124/231] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:22 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:22.170122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:22.170122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:22.170122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:22.170774 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:22.170774 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:22.170774 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:22.315020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:22.323550 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-03153bef-a888-4501-9228-3a73c02e99ea tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.168369 Aug 04 02:38:22.324312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 125/232] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:22 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:22.525282 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d39a98b5-9b16-4db2-b70d-782b936c83a2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.825670 Aug 04 02:38:22.525982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 108/233] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:38:20 2022] POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-volume_attachments => generated 194 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:22.784004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:22.784004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:22.827899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:22.845304 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:22.846930 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:22.849551 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:22.897770 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lazy-loading 'flavor' on Instance uuid 88fb61ca-19be-4d4c-a340-ec997691ac10 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:38:23.195812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:23.195812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:23.195812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:23.195812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:23.196674 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:23.197105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:23.413380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:23.423380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9f17ced3-eeac-4e2d-befd-5abca0ea60b2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1249 microversion: 2.1 time: 0.243427 Aug 04 02:38:23.424014 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 109/234] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:23 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1249 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:23.428904 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:23.429642 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:23.436207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:23.436937 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:23.437815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:23.438303 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:23.481950 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4513ae57-572c-4caa-b56e-a63a5e18728d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/action" status: 202 len: 0 microversion: 2.20 time: 0.713446 Aug 04 02:38:23.482969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 126/235] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 4 02:38:22 2022] POST /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:38:23.491541 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:23.492231 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:23.499478 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:23.499931 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:23.500692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:23.501126 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:23.586665 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:23.595246 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-029771eb-028d-478f-af1b-103db4d686d5 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.170038 Aug 04 02:38:23.605686 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 110/236] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:23 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:23.641566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:23.650798 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:23.653114 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:23.654522 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9e2db655-c99f-4490-b8e9-5b7f1e431b8e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.167187 Aug 04 02:38:23.655085 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 127/237] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:23 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:24.445197 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:24.446187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:24.453570 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:24.456274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:24.456742 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:24.457519 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:24.458023 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:24.525540 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:24.537218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0cb28e84-9033-4527-bed3-aad2ec56c08b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1297 microversion: 2.1 time: 0.096332 Aug 04 02:38:24.537929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 111/238] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:24 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:24.617840 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:24.618559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:24.626618 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:24.628658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:24.628658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:24.628658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:24.681529 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:24.683350 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:24.696563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:24.698223 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:24.701732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:24.702381 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:24.793558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:24.803630 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7f5912e6-79eb-4f21-8d8c-47aa4d7b02d1 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.190471 Aug 04 02:38:24.806727 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 128/239] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:24 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:24.835712 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-835b1262-f2dd-4583-bcf7-333c8d735454 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:24.852969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-835b1262-f2dd-4583-bcf7-333c8d735454 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:24.853421 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-835b1262-f2dd-4583-bcf7-333c8d735454 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:24.879500 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:24.894787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:24.894787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:24.894787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3408cb2d-8bac-4d2c-94ae-8fadc5dbb11e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.215975 Aug 04 02:38:24.895052 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 112/240] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:24 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:24.930544 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-835b1262-f2dd-4583-bcf7-333c8d735454 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Going to try to stop instance {{(pid=124997) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 02:38:25.206877 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-835b1262-f2dd-4583-bcf7-333c8d735454 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.374848 Aug 04 02:38:25.208259 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 129/241] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:38:24 2022] POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:38:25.216099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:25.217100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:25.226329 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.234951 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.234951 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.234951 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.470069 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:25.480005 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-33c5f484-2955-4c06-bee6-2504b9092e7e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.267769 Aug 04 02:38:25.494905 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 113/242] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:25 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:25.560559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:25.561247 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:25.567719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.568189 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.569013 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.569454 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.644757 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:25.655223 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2ffdb3d0-2529-4a96-9474-5523fc5b95bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1315 microversion: 2.1 time: 0.099550 Aug 04 02:38:25.656092 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 130/243] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:25 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1315 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:25.825290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:25.825905 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:25.832488 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.833124 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.834127 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.834587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.921121 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:25.922939 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:25.930981 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.931716 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.933104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:25.933791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:25.982807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:26.034857 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:26.043272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8bb3b054-d5b8-408e-8429-5cdf0954c8e4 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.221892 Aug 04 02:38:26.045079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 114/244] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:25 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:26.117557 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:26.126537 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:26.128037 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:26.129216 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-11eea015-bc80-4406-b0b2-243c6eaa51a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.215786 Aug 04 02:38:26.129969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 131/245] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:25 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:26.237501 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-eb5d3db5-9ea1-49fd-83bc-b6c34a6bb5a6 req-5cdd5e2c-2954-48a3-9779-0ce1317eae73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd88da7-d1d5-49de-8b65-01f03912727a", "name": "network-vif-plugged", "status": "completed", "tag": "31dc8216-1981-4a7d-9474-b81ad92a50d6"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:26.247926 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-eb5d3db5-9ea1-49fd-83bc-b6c34a6bb5a6 req-5cdd5e2c-2954-48a3-9779-0ce1317eae73 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:26.248373 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-eb5d3db5-9ea1-49fd-83bc-b6c34a6bb5a6 req-5cdd5e2c-2954-48a3-9779-0ce1317eae73 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:26.260171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-eb5d3db5-9ea1-49fd-83bc-b6c34a6bb5a6 req-5cdd5e2c-2954-48a3-9779-0ce1317eae73 service nova] Creating event network-vif-plugged:31dc8216-1981-4a7d-9474-b81ad92a50d6 for instance 4dd88da7-d1d5-49de-8b65-01f03912727a on hv-cinder-74014 Aug 04 02:38:26.265676 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-eb5d3db5-9ea1-49fd-83bc-b6c34a6bb5a6 req-5cdd5e2c-2954-48a3-9779-0ce1317eae73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Aug 04 02:38:26.266176 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 115/246] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:38:26.507736 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:26.508579 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:26.515576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:26.516148 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:26.517582 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:26.517582 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:26.680396 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:26.681200 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:26.691037 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:26.691487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:26.692267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:26.692704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:26.946621 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:26.947582 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:26.956386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6372063b-e702-482d-94fa-e23dc159c8d1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.452385 Aug 04 02:38:26.956965 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 132/247] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:26 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:26.957078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b4ad3b6a-369b-497e-99d0-b1824b3b5b25 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.278394 Aug 04 02:38:26.957610 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 116/248] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:26 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:27.065390 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:27.066065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:27.072280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.072939 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.073781 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.074358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.160146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:27.160979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:27.172075 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.172075 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.172075 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.172514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.282685 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:27.289615 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4ce058e0-b2d5-43f8-86af-07b9fcd8d3bb tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.228171 Aug 04 02:38:27.290926 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 133/249] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:27 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:27.332757 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-8d04744a-5909-4c26-a74b-c3ad89effa38 req-5e0834b7-f20a-43ff-b5e0-ebcbf213835d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab20e5a-df8f-4361-b521-1f38b500844d", "tag": "43e8622c-a7b9-4fda-95ee-56ab8dbaf238"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:27.361073 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-8d04744a-5909-4c26-a74b-c3ad89effa38 req-5e0834b7-f20a-43ff-b5e0-ebcbf213835d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.361662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-8d04744a-5909-4c26-a74b-c3ad89effa38 req-5e0834b7-f20a-43ff-b5e0-ebcbf213835d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.389562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-8d04744a-5909-4c26-a74b-c3ad89effa38 req-5e0834b7-f20a-43ff-b5e0-ebcbf213835d service nova] Creating event network-changed:43e8622c-a7b9-4fda-95ee-56ab8dbaf238 for instance bab20e5a-df8f-4361-b521-1f38b500844d on hv-cinder-74014 Aug 04 02:38:27.396899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-8d04744a-5909-4c26-a74b-c3ad89effa38 req-5e0834b7-f20a-43ff-b5e0-ebcbf213835d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072615 Aug 04 02:38:27.397777 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 134/250] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:27.422348 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:27.431673 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:27.433723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:27.435870 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f57b33fd-fe90-4cdf-bb51-8ccda5ac38d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.287063 Aug 04 02:38:27.436441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 117/251] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:27 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:27.977946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:27.978818 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:27.983978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:27.984608 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:27.986721 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.987175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.988021 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.988515 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.991294 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.991740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.992504 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:27.993146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:27.998148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:28.156294 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:28.156843 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:28.164392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c7e2a3d0-89a2-43a8-8be3-a4baf2e8e7a7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.185072 Aug 04 02:38:28.164566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8fa3a2be-40e2-4e20-bfd0-ef8c1c63709b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.190807 Aug 04 02:38:28.165085 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 118/252] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:27 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:28.165433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 135/253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:27 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:28.310741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:28.311356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:28.317350 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:28.317797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:28.318591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:28.319032 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:28.460753 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:28.462525 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:28.475771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:28.475771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:28.476633 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:28.477436 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:28.629212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:28.638215 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:28.640073 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:28.641468 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0865460a-914d-40de-b11a-4667c835fe0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.185843 Aug 04 02:38:28.655138 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 136/254] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:28 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:28.853509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:28.862154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b9839d8c-07b0-4670-8207-147c74cd1bd9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1313 microversion: 2.1 time: 0.555315 Aug 04 02:38:28.862888 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 119/255] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:28 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:29.186094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:29.186742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:29.188471 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:29.189238 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:29.194892 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.196194 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:29.197137 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.197375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.197829 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:29.198061 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:29.198625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.199111 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:29.400139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:29.403030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:29.409472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-402aa1ad-fe76-4b91-92a9-f2dda504a98c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.227761 Aug 04 02:38:29.410782 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-632f719e-0ce8-4d2b-b8dd-9639b3ca25d6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.227392 Aug 04 02:38:29.411815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 120/256] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:29 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:29.415678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 137/257] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:29 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:29.665340 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:29.668505 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:29.675718 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.676304 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:29.677265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.677697 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:29.834210 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:29.843995 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:29.845877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:29.847491 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3ce1a24b-29c0-4fdb-96d3-e010bcbf6652 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.186226 Aug 04 02:38:29.848083 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 121/258] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:29 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:29.883730 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:29.884464 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:29.890949 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.891404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:29.892186 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:29.892624 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.033772 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:30.041255 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2973ddb6-127a-4910-907b-f276e98afa42 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1497 microversion: 2.1 time: 0.161494 Aug 04 02:38:30.041853 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 138/259] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:29 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:30.431853 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:30.432466 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:30.436079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:30.436888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:30.440083 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.440535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.441305 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.441914 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.443362 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.443910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.445195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.445790 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.586312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:30.599647 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:30.605626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bb0b4891-2142-4151-a49c-b60cfd6977a2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.174309 Aug 04 02:38:30.607089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 139/260] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:30 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:30.625226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7043ee3a-84a4-4b89-a40e-75385ad241fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.197589 Aug 04 02:38:30.625960 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 122/261] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:30 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:30.872636 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:30.873498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:30.875867 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:30.881352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.881929 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.883015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.883480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.937424 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:30.938473 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:30.952218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.952218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.952218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:30.952218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:30.972916 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:38:31.036144 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:31.047313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:31.049768 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:31.049902 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3bd8e6a1-e462-4e33-a23f-e7064c013831 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.182244 Aug 04 02:38:31.050824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 140/262] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:30 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:31.265611 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4e3e38f7-2a1a-4297-9298-8ef30793bf45 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 204 len: 0 microversion: 2.1 time: 0.332225 Aug 04 02:38:31.266241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 123/263] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:38:30 2022] DELETE /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:38:31.274844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:31.275710 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:31.293093 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:31.293547 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:31.294336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:31.294800 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:31.451894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:31.461521 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3c12e4e0-3e0f-4c98-a536-dce1cf2621b7 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1503 microversion: 2.1 time: 0.190741 Aug 04 02:38:31.462106 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 141/264] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:31 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:31.628143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:31.628882 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:31.635194 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:31.635634 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:31.636393 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:31.636821 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:31.650960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:31.651809 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:31.658679 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:31.659117 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:31.660043 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:31.660557 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:31.832588 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:31.841597 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-95b6d56d-236c-40c9-b232-baee78429014 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.217678 Aug 04 02:38:31.842565 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 124/265] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:31 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:31.845553 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:31.854056 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bc212225-f2e7-4407-b299-6c4c3311b8f4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.208761 Aug 04 02:38:31.857010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 142/266] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:31 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:32.074181 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:32.075089 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:32.081445 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.086979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:32.086979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.086979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:32.252945 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:32.261672 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:32.263917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:32.265163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6f919618-0a1a-4f1d-8105-8d85616eb8cb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.195414 Aug 04 02:38:32.265743 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 125/267] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:32 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:32.488409 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:32.489452 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:32.495536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=4 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.497433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=20 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.499381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.499939 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:32.500819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.501473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:32.663470 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:32.672438 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-38f49550-0b0c-4a8e-ab50-bddd42eab570 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1503 microversion: 2.1 time: 0.191685 Aug 04 02:38:32.673237 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 143/268] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:32 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:32.862971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:32.863585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:32.870341 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.870982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:32.876949 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:32.878169 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:32.883606 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.884148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:32.891847 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.892312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:32.893420 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:32.894025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:33.105225 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:33.116742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0d6eb50c-01fa-4689-a6fc-f9be69549491 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.244295 Aug 04 02:38:33.117314 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 144/269] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:32 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:33.143050 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:33.151598 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bf98e61e-77fd-465f-91b3-16bbda1c542a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.292411 Aug 04 02:38:33.154779 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 126/270] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:32 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:33.290850 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:33.291822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:33.299135 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:33.299907 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:33.301012 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:33.301671 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:33.436610 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:33.445043 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:33.446719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:33.448012 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-dadfb2ea-da34-428c-907a-fd615233ef60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.161428 Aug 04 02:38:33.448610 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 145/271] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:33 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:33.696000 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:33.697388 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:33.704979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:33.705626 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:33.706415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:33.707537 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-d065a802-4622-41d7-bcc7-09701de16aab req-39157fce-1757-4312-ab71-d6678c909212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd88da7-d1d5-49de-8b65-01f03912727a", "name": "network-vif-deleted", "tag": "31dc8216-1981-4a7d-9474-b81ad92a50d6"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:33.708019 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:33.719493 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-d065a802-4622-41d7-bcc7-09701de16aab req-39157fce-1757-4312-ab71-d6678c909212 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:33.720287 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-d065a802-4622-41d7-bcc7-09701de16aab req-39157fce-1757-4312-ab71-d6678c909212 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:33.734634 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-d065a802-4622-41d7-bcc7-09701de16aab req-39157fce-1757-4312-ab71-d6678c909212 service nova] Creating event network-vif-deleted:31dc8216-1981-4a7d-9474-b81ad92a50d6 for instance 4dd88da7-d1d5-49de-8b65-01f03912727a on hv-cinder-74014 Aug 04 02:38:33.739938 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-d065a802-4622-41d7-bcc7-09701de16aab req-39157fce-1757-4312-ab71-d6678c909212 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035955 Aug 04 02:38:33.740663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 146/272] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:33.779736 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:33.788012 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-77d6d394-b0d8-4b39-b825-bab98caee473 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1461 microversion: 2.1 time: 0.097254 Aug 04 02:38:33.788601 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 127/273] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:33 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1461 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:34.140075 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:34.140816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:34.147451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.147985 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.153688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.153688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.176803 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:34.178942 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:34.188076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.188663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.189580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.190121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.298063 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:34.306256 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bca648fe-5670-423f-8045-5721b6d34a04 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.171208 Aug 04 02:38:34.307048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 147/274] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:34 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:34.312633 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-759d77a4-3346-4f25-be68-70c1a1571341 req-cecd8cfb-aade-410b-861d-2b8adaef519a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab20e5a-df8f-4361-b521-1f38b500844d", "name": "network-vif-plugged", "status": "completed", "tag": "43e8622c-a7b9-4fda-95ee-56ab8dbaf238"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:34.322329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-759d77a4-3346-4f25-be68-70c1a1571341 req-cecd8cfb-aade-410b-861d-2b8adaef519a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.322814 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-759d77a4-3346-4f25-be68-70c1a1571341 req-cecd8cfb-aade-410b-861d-2b8adaef519a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.335961 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-759d77a4-3346-4f25-be68-70c1a1571341 req-cecd8cfb-aade-410b-861d-2b8adaef519a service nova] Creating event network-vif-plugged:43e8622c-a7b9-4fda-95ee-56ab8dbaf238 for instance bab20e5a-df8f-4361-b521-1f38b500844d on hv-cinder-74014 Aug 04 02:38:34.342795 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-759d77a4-3346-4f25-be68-70c1a1571341 req-cecd8cfb-aade-410b-861d-2b8adaef519a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Aug 04 02:38:34.343629 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 148/275] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:34.389839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:34.397636 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fd4b6b2c-8791-4152-baf8-4d6ef41b9abd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.226507 Aug 04 02:38:34.398213 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 128/276] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:34 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:34.471429 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:34.472128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:34.478397 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.478871 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.479641 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.480102 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.644454 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:34.654250 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:34.656020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:34.657283 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-82fd7477-edfc-467c-8627-9a5e2dbee311 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.190163 Aug 04 02:38:34.658163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 149/277] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:34 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:34.809117 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:34.809731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:34.815736 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.816188 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.817004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.822018 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.850030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:34.850509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:34.850966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lazy-loading 'fault' on Instance uuid 4dd88da7-d1d5-49de-8b65-01f03912727a {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:38:34.900883 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:34.910531 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8efee1e9-296a-4a9f-9318-8f845f46a6a9 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 200 len: 1303 microversion: 2.1 time: 0.105299 Aug 04 02:38:34.911577 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 129/278] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:34 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:35.328374 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:35.329135 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:35.335920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.336458 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.337321 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.337956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.343022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=100 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:35.419297 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:35.422393 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:35.429957 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.431162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.432902 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.433486 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.504077 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:35.512731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8ca12130-42f7-421e-8e0a-e65257ada7d6 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.188234 Aug 04 02:38:35.513518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 150/279] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:35 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:35.653601 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:35.661470 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6f54314a-44aa-47c0-b9de-6366344a9e3b tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.246891 Aug 04 02:38:35.662033 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 130/280] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:35 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:35.681171 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:35.683854 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:35.688290 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.688743 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.689507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.690006 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.827672 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:35.838614 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:35.838773 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:35.839878 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-96912aba-433e-46f7-bdc4-b49f4bea75dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.163000 Aug 04 02:38:35.840437 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 151/281] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:35 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:35.933745 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:35.934418 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: 4dd88da7-d1d5-49de-8b65-01f03912727a] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:35.940345 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.940799 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.941603 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:35.942044 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:35.956121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] HTTP exception thrown: Instance 4dd88da7-d1d5-49de-8b65-01f03912727a could not be found. Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Request method failure captured: Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a HTTP/1.1 Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zER8P01QzfFU5wSCRWA2os90yqbbeG6Z1tEA6eZjuZmRtxSnzax84jwIEsFHjyIKX4aX7-i8tjSE5jWnQx_G-ZS699cM_-9XaNiiyiZiY6aqe3emJMNtyxvx_3CJrLme67l8t09vZXVBsH2FEqtkPli-m5Jeuf6g-tIMzAxPqjBcKc Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 1be664f3b7f144268f3e4e4835f16cdc Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesActionsTest-1657338602 Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:38:35.957733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesActionsTest-1657338602 Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 1be664f3b7f144268f3e4e4835f16cdc Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesActionsTest-1657338602 Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesActionsTest-1657338602-project Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 8670ec72824549f28b6530a758cbbb01 Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesActionsTest-1657338602-project Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 4dd88da7-d1d5-49de-8b65-01f03912727a could not be found. Aug 04 02:38:35.959331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '4dd88da7-d1d5-49de-8b65-01f03912727a'} Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd88da7-d1d5-49de-8b65-01f03912727a could not be found. Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:38:35.960192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd88da7-d1d5-49de-8b65-01f03912727a could not be found. Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd88da7-d1d5-49de-8b65-01f03912727a could not be found. Aug 04 02:38:35.961567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:38:35.962777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Returning 404 to user: Instance 4dd88da7-d1d5-49de-8b65-01f03912727a could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:38:35.962777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b9997413-b371-47d8-be40-e3fb9b939444 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a" status: 404 len: 111 microversion: 2.1 time: 0.029353 Aug 04 02:38:35.962777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 131/282] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:35 2022] GET /compute/v2.1/servers/4dd88da7-d1d5-49de-8b65-01f03912727a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:38:36.061811 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-737648161", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "networks": [{"uuid": "17169483-5d92-4e45-8b4b-9e66386546d3"}]}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:36.125506 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] validate_networks() for [('17169483-5d92-4e45-8b4b-9e66386546d3', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:38:36.478729 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:38:36.479257 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:38:36.479608 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:38:36.480015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:38:36.480426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:38:36.489730 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.490175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.491005 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.491890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.508220 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Getting quotas for project 1be664f3b7f144268f3e4e4835f16cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:38:36.512188 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Getting quotas for user 8670ec72824549f28b6530a758cbbb01 and project 1be664f3b7f144268f3e4e4835f16cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:38:36.523273 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:38:36.525519 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:38:36.533746 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:36.534928 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:36.537524 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:36.542248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.542740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.543503 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.544442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.651282 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-397200d7-daf1-4575-89fd-3202414b4b29 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593191 Aug 04 02:38:36.654691 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 152/283] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:38:36.675627 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-38332a6e-d41b-4a91-b27d-9e177b9b40f3 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:36.678689 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-38332a6e-d41b-4a91-b27d-9e177b9b40f3 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:36.690125 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:36.699028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4e854b9b-ca40-4cc5-bc92-a48a77ececc2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.168947 Aug 04 02:38:36.709343 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 132/284] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:36 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:36.709343 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:36.709343 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:36.721968 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.722429 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.724276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.724276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.746580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:36.776578 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-38332a6e-d41b-4a91-b27d-9e177b9b40f3 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:36.788221 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-38332a6e-d41b-4a91-b27d-9e177b9b40f3 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1213 microversion: 2.1 time: 0.125077 Aug 04 02:38:36.791224 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 153/285] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:36 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:36.865823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:36.866772 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:36.877703 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.878045 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.879507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:36.880375 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:36.937551 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:36.949409 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c58ad85b-2b99-4c7e-af89-b4f52f709b30 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1370 microversion: 2.1 time: 0.248353 Aug 04 02:38:36.952759 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 133/286] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:36 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:37.280156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:37.288690 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:37.290405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:37.291651 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fe0cc74b-a989-4922-b033-3b3ed7b07617 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.430763 Aug 04 02:38:37.292266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 154/287] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:36 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:37.722173 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:37.722816 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:37.730882 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:37.731530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:37.732263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:37.732705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:37.818733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:37.819340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:37.826396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:37.826866 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:37.827751 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:37.828763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:37.877109 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:37.886547 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9bc3c888-46ce-4615-8e2e-1ea74cc62043 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.168214 Aug 04 02:38:37.887270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 134/288] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:37 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:37.908666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:37.916940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0ff25879-9812-47c2-8e44-d5eca8d3043d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1217 microversion: 2.1 time: 0.102023 Aug 04 02:38:37.917500 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 155/289] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:37 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:37.976196 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:37.977117 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:37.984796 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:37.985248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:37.986009 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:37.986444 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.128130 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:38.135914 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ceedfd0f-fd7e-4680-8721-ba18e16eb6d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1565 microversion: 2.1 time: 0.163626 Aug 04 02:38:38.136493 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 135/290] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:37 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:38.156742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e4d81b9e-18cd-44d4-a4d8-eec96948476e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:38.157362 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e4d81b9e-18cd-44d4-a4d8-eec96948476e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:38.163663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4d81b9e-18cd-44d4-a4d8-eec96948476e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.164125 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4d81b9e-18cd-44d4-a4d8-eec96948476e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.176176 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4d81b9e-18cd-44d4-a4d8-eec96948476e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.176176 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e4d81b9e-18cd-44d4-a4d8-eec96948476e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.260944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e4d81b9e-18cd-44d4-a4d8-eec96948476e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108386 Aug 04 02:38:38.261575 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 156/291] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:38:38 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:38.315267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:38.315920 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:38.322323 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.331930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.331930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.331930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.583712 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:38.592033 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:38.593559 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:38.594751 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ba230844-c5f2-416c-b39c-7078d9856892 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.284284 Aug 04 02:38:38.595322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 136/292] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:38 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:38.909390 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:38.910173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:38.917216 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.917849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.919223 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.919807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.940838 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:38.943324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:38.953024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.953823 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:38.955572 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:38.956452 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:39.081596 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:39.091019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6c5fc1ee-cd6b-409b-9900-81544dc943b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.185567 Aug 04 02:38:39.091701 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 157/293] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:38 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:39.098923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:39.108492 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a0a82576-2c74-4d5a-b229-5fda790f7bab tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1273 microversion: 2.1 time: 0.175225 Aug 04 02:38:39.109081 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 137/294] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:38 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:39.617375 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:39.617983 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:39.625097 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:39.627803 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:39.627803 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:39.627803 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:39.802130 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:39.808335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:39.811011 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:39.812179 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bac56d74-b2ac-4d6d-8776-ffe8b0dbf22d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.198785 Aug 04 02:38:39.812738 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 158/295] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:39 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:40.003189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-8e871968-2cdc-4492-9d7e-ea868c073231 req-cb9bfbe4-0150-4f06-bbc8-54629fdb01fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab20e5a-df8f-4361-b521-1f38b500844d", "tag": "43e8622c-a7b9-4fda-95ee-56ab8dbaf238"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:40.017203 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8e871968-2cdc-4492-9d7e-ea868c073231 req-cb9bfbe4-0150-4f06-bbc8-54629fdb01fa service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:40.017671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8e871968-2cdc-4492-9d7e-ea868c073231 req-cb9bfbe4-0150-4f06-bbc8-54629fdb01fa service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:40.035769 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-8e871968-2cdc-4492-9d7e-ea868c073231 req-cb9bfbe4-0150-4f06-bbc8-54629fdb01fa service nova] Creating event network-changed:43e8622c-a7b9-4fda-95ee-56ab8dbaf238 for instance bab20e5a-df8f-4361-b521-1f38b500844d on hv-cinder-74014 Aug 04 02:38:40.061468 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-8e871968-2cdc-4492-9d7e-ea868c073231 req-cb9bfbe4-0150-4f06-bbc8-54629fdb01fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064366 Aug 04 02:38:40.062518 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 138/296] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:40.112824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:40.113615 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:40.124140 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:40.127137 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:40.128804 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:40.130664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:40.130934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:40.131914 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:40.158671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:40.159175 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:40.160025 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:40.160495 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:40.345556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:40.354146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-090b8eda-b6e6-490d-b1c7-536cef11f595 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1271 microversion: 2.1 time: 0.226792 Aug 04 02:38:40.366081 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 139/297] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:40 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:40.504526 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:40.530687 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bd53bbd8-134e-4f9a-8a4b-f5d5fb99ac3b tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1723 microversion: 2.1 time: 0.414346 Aug 04 02:38:40.534842 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 159/298] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:40 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:40.837446 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:40.838046 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:40.848402 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:40.848845 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:40.862918 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:40.863683 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:41.147663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:41.156574 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:41.158157 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:41.159870 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-47bbd1c0-e382-4777-a5ac-5f3ceb917ec8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.326535 Aug 04 02:38:41.160620 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 140/299] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:40 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:41.377967 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:41.378721 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:41.385642 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:41.386470 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:41.387708 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:41.389261 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:41.553155 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:41.557577 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:41.558188 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:41.563308 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d1202031-7fcb-4e6c-8a7a-a9048bec8e1f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.189320 Aug 04 02:38:41.564455 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 160/300] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:41 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:41.578691 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:41.579384 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:41.580439 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:41.587262 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:41.739346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:41.747485 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9d11f8f5-132e-4642-9084-3e823308a5d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1700 microversion: 2.1 time: 0.193688 Aug 04 02:38:41.748338 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 141/301] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:41 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1700 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:41.773281 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-17cd33ee-d182-4e7b-86e3-f0920e5550b3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:41.782736 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17cd33ee-d182-4e7b-86e3-f0920e5550b3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:41.787979 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17cd33ee-d182-4e7b-86e3-f0920e5550b3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:41.813667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-17cd33ee-d182-4e7b-86e3-f0920e5550b3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Going to try to start instance {{(pid=124997) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 02:38:41.952996 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-17cd33ee-d182-4e7b-86e3-f0920e5550b3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.183370 Aug 04 02:38:41.953924 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 161/302] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:38:41 2022] POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:38:41.962137 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:41.962772 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:41.970202 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:41.971030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:41.972379 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:41.973130 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:42.085688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-36040f07-7fc7-466b-ab7c-56940e437f8e req-c564051d-5fe9-4c2a-8f87-76305d41621b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f3efe8-0c3b-4665-974f-1372f2aa8842", "tag": "2aff813f-2317-45f5-b31e-7fe2ccff8bb7"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:42.099208 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-36040f07-7fc7-466b-ab7c-56940e437f8e req-c564051d-5fe9-4c2a-8f87-76305d41621b service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:42.099451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-36040f07-7fc7-466b-ab7c-56940e437f8e req-c564051d-5fe9-4c2a-8f87-76305d41621b service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:42.113981 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-36040f07-7fc7-466b-ab7c-56940e437f8e req-c564051d-5fe9-4c2a-8f87-76305d41621b service nova] Creating event network-changed:2aff813f-2317-45f5-b31e-7fe2ccff8bb7 for instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 on hv-cinder-74014 Aug 04 02:38:42.121269 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-36040f07-7fc7-466b-ab7c-56940e437f8e req-c564051d-5fe9-4c2a-8f87-76305d41621b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039638 Aug 04 02:38:42.122397 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 162/303] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:42.187909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:42.189240 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:42.201589 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:42.202065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:42.202958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:42.203399 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:42.230018 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:42.244007 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e522405e-5a61-4d02-b67e-0fe45a736eb4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1709 microversion: 2.1 time: 0.285696 Aug 04 02:38:42.244949 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 142/304] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:41 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1709 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:42.396883 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:42.406173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:42.407942 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:42.409115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4359aa4a-d09a-4b50-a453-bb75acca6ea3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.227663 Aug 04 02:38:42.409914 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 163/305] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:42 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:42.585795 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:42.586680 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:42.592645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:42.593086 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:42.593842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:42.594272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:42.744162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:42.749567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4be6fc44-ca70-4996-8667-7c2c118a25a6 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.168352 Aug 04 02:38:42.750145 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 143/306] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:42 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:43.266274 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:43.266943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:43.274762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:43.275195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:43.275964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:43.276393 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:43.433892 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:43.435153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:43.452777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:43.454111 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:43.454441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:43.454901 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:43.532110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:43.540741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e121a6ed-4120-4e60-a239-bb3c2795b3e7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1709 microversion: 2.1 time: 0.278429 Aug 04 02:38:43.541707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 164/307] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:43 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1709 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:43.681892 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:43.693830 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:43.695391 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:43.696560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-22e9921d-6870-42b8-a6d9-5b5303af2bf1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.266728 Aug 04 02:38:43.698626 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 144/308] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:43 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:43.773638 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:43.774348 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:43.781835 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:43.782290 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:43.783152 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:43.783591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:43.922207 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:43.929951 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-eee9210d-bf8f-465d-bfe3-7d68e56cec17 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.161602 Aug 04 02:38:43.930558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 165/309] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:43 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:44.563945 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:44.564643 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:44.571600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:44.572169 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:44.572939 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:44.573378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:44.711781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:44.721748 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-928436d5-a3ee-42a7-82ba-f61d7a1c0b8f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1713 microversion: 2.1 time: 0.160840 Aug 04 02:38:44.721748 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 145/310] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:44 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:44.723393 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:44.725212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:44.731984 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:44.732361 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:44.733173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:44.733603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:44.875324 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:44.883725 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:44.885307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:44.886618 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c232c060-69ce-4c4d-a472-01c187b3acda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1745 microversion: 2.20 time: 0.167529 Aug 04 02:38:44.888051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 166/311] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:44 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:44.952923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:44.953569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:44.959734 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:44.960175 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:44.960932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:44.961364 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:45.112127 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:45.120188 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-be090331-33f9-40f5-b08c-b1998ee6291e tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.171898 Aug 04 02:38:45.120791 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 146/312] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:44 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:45.915259 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:45.915866 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:45.921972 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:45.922422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:45.923319 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:45.923749 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:46.065795 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:46.080064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:46.080064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:46.080064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8ba46eda-fe08-428d-a06e-3f448382b6d8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1745 microversion: 2.20 time: 0.166734 Aug 04 02:38:46.080474 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 167/313] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:45 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:46.142062 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:46.148013 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:46.148868 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:46.149313 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:46.150069 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:46.150511 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:46.330835 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:46.341767 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6c73a612-5437-4920-9869-71ef811be474 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.203247 Aug 04 02:38:46.343399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 147/314] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:46 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:47.103089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:47.104022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:47.106901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:47.107956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=8 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:47.114293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:47.114711 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:47.115518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:47.116424 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:47.141039 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:47.280561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:47.289992 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:47.291696 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:47.293063 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7a135938-c583-4068-9b27-d260f1659b5b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1745 microversion: 2.20 time: 0.196021 Aug 04 02:38:47.306755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 168/315] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:47 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1745 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:47.362437 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:47.363108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:47.369557 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:47.369996 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:47.370780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:47.371212 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:47.514840 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:47.522976 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-934a2bb7-68a7-4f4f-a679-1973eac70cc2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.164428 Aug 04 02:38:47.523554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 148/316] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:47 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:48.149919 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-a59cd989-32e2-4051-968d-53ff013a22e5 req-9ff423e4-72de-4e21-bf03-670d2559f36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fb61ca-19be-4d4c-a340-ec997691ac10", "name": "network-vif-plugged", "status": "completed", "tag": "47529bd5-9d31-4f9f-8fd1-96a64c939a51"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:48.170920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a59cd989-32e2-4051-968d-53ff013a22e5 req-9ff423e4-72de-4e21-bf03-670d2559f36c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:48.171890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a59cd989-32e2-4051-968d-53ff013a22e5 req-9ff423e4-72de-4e21-bf03-670d2559f36c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:48.184778 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-a59cd989-32e2-4051-968d-53ff013a22e5 req-9ff423e4-72de-4e21-bf03-670d2559f36c service nova] Creating event network-vif-plugged:47529bd5-9d31-4f9f-8fd1-96a64c939a51 for instance 88fb61ca-19be-4d4c-a340-ec997691ac10 on hv-cinder-74014 Aug 04 02:38:48.199619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-a59cd989-32e2-4051-968d-53ff013a22e5 req-9ff423e4-72de-4e21-bf03-670d2559f36c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054784 Aug 04 02:38:48.200252 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 169/317] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:48.316910 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:48.317520 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:48.330328 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:48.330624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:48.331615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:48.332070 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:48.548073 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:48.549167 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:48.560424 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:48.561258 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:48.562332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:48.563013 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:48.602787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:48.613123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:48.615133 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:48.616588 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a629d93d-e76e-463e-bf05-e467d2eefc83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.303583 Aug 04 02:38:48.617671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 149/318] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:48 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:48.748876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:48.763522 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5b96c82b-ab65-4841-b999-f1b02e680e33 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.222284 Aug 04 02:38:48.764580 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 170/319] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:48 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:49.641737 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:49.643021 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:49.654277 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:49.655051 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:49.656065 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:49.656707 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:49.786879 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:49.787469 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:49.797719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:49.798301 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:49.802745 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:49.803220 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:49.895710 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:49.900322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=100 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:49.909441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:49.911430 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:49.912841 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-61908aab-7a67-4952-911e-813fb398e5d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.276110 Aug 04 02:38:49.914202 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 150/320] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:49 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:50.172590 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:50.180974 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-974da63c-b861-4356-b86d-c74827ea2d62 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.398859 Aug 04 02:38:50.181576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 171/321] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:49 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:50.236022 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-977e9586-2f88-4f52-a494-d1df4e1b4969 req-7b4a60f5-ffe0-42e8-8a08-39bacf934e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f3efe8-0c3b-4665-974f-1372f2aa8842", "name": "network-vif-plugged", "status": "completed", "tag": "2aff813f-2317-45f5-b31e-7fe2ccff8bb7"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:50.249932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-977e9586-2f88-4f52-a494-d1df4e1b4969 req-7b4a60f5-ffe0-42e8-8a08-39bacf934e9c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:50.250594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-977e9586-2f88-4f52-a494-d1df4e1b4969 req-7b4a60f5-ffe0-42e8-8a08-39bacf934e9c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:50.265990 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-977e9586-2f88-4f52-a494-d1df4e1b4969 req-7b4a60f5-ffe0-42e8-8a08-39bacf934e9c service nova] Creating event network-vif-plugged:2aff813f-2317-45f5-b31e-7fe2ccff8bb7 for instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 on hv-cinder-74014 Aug 04 02:38:50.271931 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-977e9586-2f88-4f52-a494-d1df4e1b4969 req-7b4a60f5-ffe0-42e8-8a08-39bacf934e9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039537 Aug 04 02:38:50.272689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 151/322] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:50.940203 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:50.940961 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:50.953485 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:50.956595 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:50.957834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:50.959439 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:51.207240 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:51.207955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:51.232059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:51.232540 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:51.233357 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:51.246141 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:51.375266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:51.385684 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:51.388551 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:51.392006 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8d2aea98-db42-49ec-afa9-94d97b84d029 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.457359 Aug 04 02:38:51.417051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 172/323] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:50 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:51.500644 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:51.509451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-67160254-646e-4b18-bbea-ac1c51c22d9b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1313 microversion: 2.1 time: 0.307354 Aug 04 02:38:51.510711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 152/324] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:51 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:52.429935 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:52.430688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:52.445778 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:52.446232 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:52.447125 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:52.447792 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:52.532123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:52.541775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:52.568273 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:52.569145 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:52.570267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:52.575642 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:52.857780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:52.870143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d412d744-2cda-42df-aa06-89f41c3e658f tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1497 microversion: 2.1 time: 0.342098 Aug 04 02:38:52.875252 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 153/325] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:52 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1497 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:52.970550 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:52.996526 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:53.000816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:53.006435 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-518659de-4f74-4e34-9532-a3e1712be7b7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.579793 Aug 04 02:38:53.007256 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 173/326] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:52 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:53.995970 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:53.998397 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:54.018943 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:54.019786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:54.023339 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:54.025556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:54.034186 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:54.035578 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:54.057141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:54.058047 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:54.059240 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:54.060485 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:54.135571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:38:54.311810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:54.328001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:54.329879 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:54.331767 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d69e792a-fdae-44ee-ac35-1f515362263c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.302191 Aug 04 02:38:54.332909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 174/327] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:54 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:38:54.580072 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-16922045-9bc1-4162-bde5-be3aa262b9c2 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 204 len: 0 microversion: 2.1 time: 0.590374 Aug 04 02:38:54.581551 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 154/328] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:38:53 2022] DELETE /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:38:54.589826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:54.592663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:54.605484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:54.605935 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:54.609345 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:54.610358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:54.861145 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:54.874950 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-575bd9d1-ca12-4eac-98c4-b11fa32e4b4d tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1503 microversion: 2.1 time: 0.286010 Aug 04 02:38:54.876512 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 175/329] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:54 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:55.358057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:55.359904 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:55.374839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:55.375719 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:55.376778 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:55.377514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:55.666454 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:55.682291 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:55.687893 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:55.692057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ca987a8a-66d0-4705-8350-8c3065950299 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.338677 Aug 04 02:38:55.693604 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 155/330] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:55 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:55.902001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:55.910048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:55.911209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:55.911883 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:55.912722 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:55.913166 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:56.095231 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:56.107780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-009e17e3-ccac-4c95-a1a6-f3740fcc8d5c tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1503 microversion: 2.1 time: 0.214333 Aug 04 02:38:56.118035 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 176/331] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:55 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:56.721532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:56.723030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:56.742684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:56.743787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:56.745543 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:56.748451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:57.120537 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:57.134893 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:57.136138 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:57.143877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:57.145693 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:57.146389 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:57.147559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:57.147671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:57.148090 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:57.148808 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0d214ccd-e7da-43c2-9a0d-75677b34453d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.431239 Aug 04 02:38:57.163788 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 156/332] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:56 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:57.332197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:57.347727 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-34cb6b1f-320a-40dd-ad0a-ad45a1e2c59b tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1503 microversion: 2.1 time: 0.221948 Aug 04 02:38:57.361885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 177/333] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:57 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:38:58.179189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:58.179990 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:58.187102 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:58.187558 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:58.188632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:58.189101 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:58.368064 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:58.369874 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:58.371388 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:58.376391 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:58.377997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:58.379054 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:58.379377 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c3e0fd2c-243a-4625-8b3e-565f7ed30ca8 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.205815 Aug 04 02:38:58.379823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:58.380061 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 157/334] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:58 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:58.381372 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:58.381952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:58.525898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:58.554356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9178e5c8-de50-44ee-a7f9-1dfb53997945 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1503 microversion: 2.1 time: 0.188639 Aug 04 02:38:58.566793 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 178/335] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:58 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:38:58.592236 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-5900dbab-e0a7-4dfb-9b86-dfafef3399b9 req-a244fa44-863d-41a7-b97d-6684f09c6e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f3efe8-0c3b-4665-974f-1372f2aa8842", "name": "network-vif-deleted", "tag": "2aff813f-2317-45f5-b31e-7fe2ccff8bb7"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:38:58.609126 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5900dbab-e0a7-4dfb-9b86-dfafef3399b9 req-a244fa44-863d-41a7-b97d-6684f09c6e6f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:58.612243 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5900dbab-e0a7-4dfb-9b86-dfafef3399b9 req-a244fa44-863d-41a7-b97d-6684f09c6e6f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:58.631559 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-5900dbab-e0a7-4dfb-9b86-dfafef3399b9 req-a244fa44-863d-41a7-b97d-6684f09c6e6f service nova] Creating event network-vif-deleted:2aff813f-2317-45f5-b31e-7fe2ccff8bb7 for instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 on hv-cinder-74014 Aug 04 02:38:58.652531 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-5900dbab-e0a7-4dfb-9b86-dfafef3399b9 req-a244fa44-863d-41a7-b97d-6684f09c6e6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064524 Aug 04 02:38:58.656774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 158/336] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:38:59.403822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:59.404821 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:59.414307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:59.415520 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:59.415682 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:59.416058 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:59.579152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:38:59.579879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:38:59.596071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:59.596071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:59.596071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:59.598321 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:59.657421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:38:59.657421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:38:59.657421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lazy-loading 'fault' on Instance uuid e7f3efe8-0c3b-4665-974f-1372f2aa8842 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:38:59.661223 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:59.670771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:59.673293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:59.680481 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fb4c0320-3e20-4eea-8252-6be917b47f66 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.281421 Aug 04 02:38:59.681660 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 179/337] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:38:59 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:38:59.736815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8670ec72824549f28b6530a758cbbb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be664f3b7f144268f3e4e4835f16cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:38:59.769789 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bf41527d-eb2e-4752-9faa-8e7cf849803a tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 200 len: 1303 microversion: 2.1 time: 0.196070 Aug 04 02:38:59.773113 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 159/338] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:38:59 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:00.708350 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:00.708973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:00.721764 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:00.722229 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:00.723051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:00.723686 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:00.794369 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:00.795690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] [instance: e7f3efe8-0c3b-4665-974f-1372f2aa8842] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:00.806175 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:00.808625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:00.810589 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:00.811234 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:00.831643 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] HTTP exception thrown: Instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 could not be found. Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Request method failure captured: Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 HTTP/1.1 Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zER8P01QzfFU5wSCRWA2os90yqbbeG6Z1tEA6eZjuZmRtxSnzax84jwIEsFHjyIKX4aX7-i8tjSE5jWnQx_G-ZS699cM_-9XaNiiyiZiY6aqe3emJMNtyxvx_3CJrLme67l8t09vZXVBsH2FEqtkPli-m5Jeuf6g-tIMzAxPqjBcKc Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 1be664f3b7f144268f3e4e4835f16cdc Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesActionsTest-1657338602 Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:39:00.833731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1be664f3b7f144268f3e4e4835f16cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesActionsTest-1657338602 Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 1be664f3b7f144268f3e4e4835f16cdc Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesActionsTest-1657338602 Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesActionsTest-1657338602-project Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 8670ec72824549f28b6530a758cbbb01 Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesActionsTest-1657338602-project Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 could not be found. Aug 04 02:39:00.835084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'e7f3efe8-0c3b-4665-974f-1372f2aa8842'} Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 could not be found. Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:39:00.836100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 could not be found. Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 could not be found. Aug 04 02:39:00.837370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:00.859933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] Returning 404 to user: Instance e7f3efe8-0c3b-4665-974f-1372f2aa8842 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:39:00.860963 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8e7ce555-de64-4802-a026-0bd25e2ce980 tempest-VolumesActionsTest-1657338602 tempest-VolumesActionsTest-1657338602-project] 10.222.0.60 "GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842" status: 404 len: 111 microversion: 2.1 time: 0.070848 Aug 04 02:39:00.866980 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 160/339] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:00 2022] GET /compute/v2.1/servers/e7f3efe8-0c3b-4665-974f-1372f2aa8842 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:39:01.006785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:01.023256 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:01.025393 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:01.027410 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-054abb0d-34c7-4d4f-bbf2-70cd9868b7a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.323041 Aug 04 02:39:01.029296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 180/340] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:00 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:02.052335 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:02.052865 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:02.063671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:02.065473 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:02.066883 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:02.068329 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:02.717590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:02.763251 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:02.769222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:02.772954 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1f694f7c-f5d7-4579-86b9-7da47ad98864 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.725419 Aug 04 02:39:02.775235 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 161/341] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:02 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:03.803847 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:03.804531 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:03.823880 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:03.823880 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:03.823880 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:03.823880 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:03.824513 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:04.031959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:04.042477 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:04.048528 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:04.049790 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a262ae83-80ee-4bc6-835a-b432ad6b0d3d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.251332 Aug 04 02:39:04.050980 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 181/342] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:03 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:05.075838 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:05.077890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:05.098933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:05.102077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:05.106941 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:05.107659 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:05.455074 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:05.473217 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:05.475862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:05.478975 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-81fcdc92-64e0-41c5-8594-9eb0f4175e56 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.409581 Aug 04 02:39:05.485380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 162/343] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:05 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:06.512078 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:06.513546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:06.524728 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:06.525130 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:06.526753 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:06.527357 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:06.780688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:06.790826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:06.799479 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:06.801030 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4f1dd881-efa2-438a-ac92-a7a990900e54 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1740 microversion: 2.20 time: 0.294508 Aug 04 02:39:06.815958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 182/344] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:06 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:07.831357 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:07.832646 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:07.842781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:07.843596 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:07.844609 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:07.845253 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:08.062624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:08.072406 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:08.074196 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:08.079370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-586e4497-5833-4b23-94dd-0ea57c652a60 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1722 microversion: 2.20 time: 0.256800 Aug 04 02:39:08.080738 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 163/345] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:07 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:08.586270 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d27d4e49-205b-4542-b99f-a9e0493b4811 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Action: 'create', calling method: .version_select at 0x7fa646442ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1504962787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgEh4niYNHFbA2cY5dyKdGASbldqrIyokuYAFRXBcOypeWGiwkr4njfpNzYssv/H6ylB5ly8ZxPri9JMkCqh9e96nfDs0/neqFMUfKZBBtXnOxn435r20ZBme8oiFHEHg=="}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:08.620516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-d27d4e49-205b-4542-b99f-a9e0493b4811 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Getting quotas for project a49dcb863cd24a3cab8162c18ddf78f0. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:39:08.625879 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-d27d4e49-205b-4542-b99f-a9e0493b4811 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Getting quotas for user 5091a0547e964c6d80b947191072e809 and project a49dcb863cd24a3cab8162c18ddf78f0. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:39:08.724936 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d27d4e49-205b-4542-b99f-a9e0493b4811 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.541976 Aug 04 02:39:08.726868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 183/346] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:39:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:39:09.153767 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:09.159491 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:09.169688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:09.214523 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:09.216094 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:09.216955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:09.222993 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:09.487848 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:09.510787 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:09.512649 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:09.516511 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-510b6c13-3d5e-4df4-a5d8-a0d37746f6a9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1722 microversion: 2.20 time: 0.398463 Aug 04 02:39:09.519797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 164/347] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:09 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:10.298427 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-7a4c6e2b-8094-4936-9565-e12059782c50 req-4fdb45a8-e026-4490-a85b-e3f198566258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fb61ca-19be-4d4c-a340-ec997691ac10", "name": "network-vif-unplugged", "status": "completed", "tag": "47529bd5-9d31-4f9f-8fd1-96a64c939a51"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:10.331730 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-7a4c6e2b-8094-4936-9565-e12059782c50 req-4fdb45a8-e026-4490-a85b-e3f198566258 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:10.332671 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-7a4c6e2b-8094-4936-9565-e12059782c50 req-4fdb45a8-e026-4490-a85b-e3f198566258 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:10.352563 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.compute.server_external_events [req-7a4c6e2b-8094-4936-9565-e12059782c50 req-4fdb45a8-e026-4490-a85b-e3f198566258 service nova] Unable to find a host for instance 88fb61ca-19be-4d4c-a340-ec997691ac10. Dropping event network-vif-unplugged {{(pid=124997) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 02:39:10.354719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-7a4c6e2b-8094-4936-9565-e12059782c50 req-4fdb45a8-e026-4490-a85b-e3f198566258 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065509 Aug 04 02:39:10.360218 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 184/348] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 02:39:10.547322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:10.551299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:10.559876 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:10.560565 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:10.561413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:10.562013 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:10.741207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:10.750719 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:10.752715 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:10.754065 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-429adc88-04ef-46f8-b0df-3ee1b1410ccf tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1665 microversion: 2.20 time: 0.215608 Aug 04 02:39:10.754815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 165/349] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:10 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1665 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:10.786745 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5db92c68-ffc7-4fa8-a19e-6b100609db71 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7f3f9ab-d4b4-420b-818a-5d1c9a8e7a5c"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:10.795306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5db92c68-ffc7-4fa8-a19e-6b100609db71 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:10.816569 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5db92c68-ffc7-4fa8-a19e-6b100609db71 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:10.824521 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5db92c68-ffc7-4fa8-a19e-6b100609db71 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:10.826109 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5db92c68-ffc7-4fa8-a19e-6b100609db71 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:10.826740 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5db92c68-ffc7-4fa8-a19e-6b100609db71 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:11.686991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:12.156174 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5db92c68-ffc7-4fa8-a19e-6b100609db71 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.377923 Aug 04 02:39:12.158665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 185/350] 10.222.0.60 () {62 vars in 1364 bytes} [Thu Aug 4 02:39:10 2022] POST /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments => generated 188 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:39:12.311109 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:12.312313 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:12.319600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:12.320380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:12.321380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:12.322028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:12.386801 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124996) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 02:39:12.523260 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:12.698277 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bf782b5c-00d0-4252-9e47-d4377c56d5f9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/action" status: 202 len: 0 microversion: 2.20 time: 0.391952 Aug 04 02:39:12.707482 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:12.708666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:12.717517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 166/351] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 4 02:39:12 2022] POST /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:39:12.719981 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:12.720852 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:12.723227 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:12.725236 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:12.909599 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:12.938088 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:12.944876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:12.950634 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8127c868-a6be-4a6c-8923-cc2b1caa74ad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1751 microversion: 2.20 time: 0.246988 Aug 04 02:39:12.951999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 186/352] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:12 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1751 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:13.975590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:13.976886 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:13.984263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:13.984965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:13.985916 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:13.986574 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:14.181327 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:14.197913 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:14.199959 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:14.201474 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-25bc7535-5bd3-414a-a1e5-f8c92b2ded01 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1751 microversion: 2.20 time: 0.230528 Aug 04 02:39:14.211382 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 167/353] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:13 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:15.228481 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:15.229513 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:15.241481 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:15.241972 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:15.243915 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:15.244765 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:15.450595 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:15.466788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:15.468501 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:15.469724 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4349faa7-46e8-420c-b493-f62bcf38c0b4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1751 microversion: 2.20 time: 0.246666 Aug 04 02:39:15.490067 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 187/354] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:15 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:16.498781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:16.500081 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:16.506797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:16.507460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:16.508832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:16.509274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:16.680284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:16.689810 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:16.691348 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:16.692507 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1938151a-5409-45e1-be6f-165b416c6c22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1753 microversion: 2.20 time: 0.198486 Aug 04 02:39:16.693247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 168/355] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:16 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:17.723313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:17.724022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:17.735022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:17.735816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:17.736656 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:17.737285 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:17.904251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:17.915691 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:17.917579 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:17.920182 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-dd926854-270d-40f9-a34e-3350fc4997c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.201630 Aug 04 02:39:17.920980 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 188/356] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:17 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:18.950722 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:18.951278 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:18.959272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:18.959721 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:18.960732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:18.961177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:19.127495 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:19.139276 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:19.141032 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:19.142697 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-cd077a91-e4de-4889-9408-c4380cbd4251 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.197394 Aug 04 02:39:19.145030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 169/357] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:18 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:20.171792 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:20.172426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:20.174387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=4 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:20.181026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:20.181602 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:20.182566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:20.183249 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:20.336911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:20.346146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:20.347804 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:20.349074 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-dd1c62d0-1dac-4471-813f-57664ceac736 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.182291 Aug 04 02:39:20.349710 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 189/358] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:20 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:21.374771 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:21.375422 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:21.382517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:21.383058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:21.384029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:21.384497 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:21.536914 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:21.546875 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:21.548602 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:21.549783 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bf72aa9e-4602-4d52-8c59-2d2329863c14 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.179821 Aug 04 02:39:21.550365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 170/359] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:21 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:22.573790 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:22.575287 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:22.583212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:22.583921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:22.584884 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:22.585379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:22.735130 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:22.744065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:22.745576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:22.746785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-50b725ca-4efe-46c6-b53c-67c385aec62a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.177325 Aug 04 02:39:22.763154 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 190/360] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:22 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:23.770087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:23.771017 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:23.777487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:23.778760 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:23.781110 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:23.781110 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:23.955967 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:23.965201 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:23.966765 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:23.968115 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bd240626-facb-4b66-9e2a-9337c29b5ad6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.202162 Aug 04 02:39:23.968681 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 171/361] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:23 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:24.029129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a25b9d7d-cfa2-42db-a36c-562ce8736e38 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b58dddee-6262-4cf2-9c71-b9807eb315dc"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:24.032054 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a25b9d7d-cfa2-42db-a36c-562ce8736e38 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:24.045920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a25b9d7d-cfa2-42db-a36c-562ce8736e38 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:24.046897 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a25b9d7d-cfa2-42db-a36c-562ce8736e38 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:24.047133 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a25b9d7d-cfa2-42db-a36c-562ce8736e38 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:24.047568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a25b9d7d-cfa2-42db-a36c-562ce8736e38 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:24.863561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a25b9d7d-cfa2-42db-a36c-562ce8736e38 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838503 Aug 04 02:39:24.870434 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 191/362] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:39:24 2022] POST /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments => generated 194 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:39:24.992214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:24.998937 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:25.001624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:25.002322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:25.003420 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:25.003859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:25.167146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:25.177105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:25.180879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:25.180879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e7a4c249-cc1d-4fea-b74d-69212dc01019 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.192282 Aug 04 02:39:25.180879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 172/363] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:24 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:26.204967 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:26.205602 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:26.212140 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:26.212590 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:26.213354 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:26.213822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:26.361194 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:26.371768 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:26.374941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:26.376758 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0dcaa6c9-a83d-43b1-a5cf-a8ce719bcd5a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.176782 Aug 04 02:39:26.393466 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 192/364] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:26 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:26.704990 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:26.706108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:26.728121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:26.728121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:26.728121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:26.728798 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:26.894702 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lazy-loading 'services' on Instance uuid ab1c4809-6fd6-4207-b2e0-7b9801de9c0f {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:39:27.158718 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:27.160961 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:27.167556 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:27.168010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:27.168785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:27.169227 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:27.196639 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lazy-loading 'flavor' on Instance uuid bab20e5a-df8f-4361-b521-1f38b500844d {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:39:27.215532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-325212a6-7aff-4d33-a8ba-42690d5fac64 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-volume_attachments/fb829079-fa47-4fb0-9c2a-7e66b6f3cac7" status: 202 len: 0 microversion: 2.1 time: 0.515815 Aug 04 02:39:27.248856 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 173/365] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:39:26 2022] DELETE /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-volume_attachments/fb829079-fa47-4fb0-9c2a-7e66b6f3cac7 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:39:27.406711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:27.410984 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:27.416692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:27.417356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:27.418328 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:27.418775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:27.568482 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f914057c-1345-494f-9977-d5f87e38eeae tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/action" status: 200 len: 32 microversion: 2.1 time: 0.413941 Aug 04 02:39:27.570873 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 193/366] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:39:27 2022] POST /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/action => generated 32 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 02:39:27.583303 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:27.584033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:27.594359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:27.596999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:27.597566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:27.598620 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:27.599063 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:27.604517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:27.606545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:27.608740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8cd5f799-012c-4d08-beb4-86a377eec735 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.207512 Aug 04 02:39:27.609852 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 174/367] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:27 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:27.789920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:27.799301 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bde29c8b-1610-4b21-b702-94a4b0c0f712 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.224021 Aug 04 02:39:27.800157 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 194/368] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:27 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:28.372577 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-696bc7ad-b36c-497c-8b63-5ae9499d8a8e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:28.379985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-696bc7ad-b36c-497c-8b63-5ae9499d8a8e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:28.380514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-696bc7ad-b36c-497c-8b63-5ae9499d8a8e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:28.446938 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-696bc7ad-b36c-497c-8b63-5ae9499d8a8e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Going to try to stop instance {{(pid=124996) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 02:39:28.616354 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-696bc7ad-b36c-497c-8b63-5ae9499d8a8e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.247855 Aug 04 02:39:28.617134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 175/369] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:39:28 2022] POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:39:28.628000 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:28.628000 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:28.634112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:28.634812 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:28.635158 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:28.635289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:28.636032 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:28.636471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:28.644803 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:28.645808 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:28.646708 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:28.647220 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:28.781050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:28.789685 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5029c711-b2fc-4eb0-823a-5072e4ff0026 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.167734 Aug 04 02:39:28.790896 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 195/370] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:28 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:28.795851 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:28.805774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:28.807554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:28.809174 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b7679c8f-dd71-4397-ac02-c3a47907217c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.179584 Aug 04 02:39:28.810304 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 176/371] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:28 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:28.823480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:28.828113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:28.831524 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:28.832170 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:28.833192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:28.833782 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:28.990287 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:29.001757 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-81ac8865-55c8-45f9-97e7-524d497955a9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.181522 Aug 04 02:39:29.007061 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 196/372] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:28 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:29.814433 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:29.815059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:29.822394 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:29.822860 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:29.823824 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:29.824253 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:29.841113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:29.841854 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:29.848630 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:29.849068 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:29.849849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:29.850368 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:30.021510 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:30.035807 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:30.041036 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:30.043218 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:30.044794 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e1f8db94-bbc8-42ba-9a05-d7b5829527ff tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.207805 Aug 04 02:39:30.046511 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-aae284dd-e4e2-4097-8150-3f62e7fa8f4a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.236995 Aug 04 02:39:30.046928 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 197/373] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:29 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:30.049187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 177/374] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:29 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:30.053142 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:30.053866 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:30.062450 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:30.105406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:30.105406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:30.105406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:30.105406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=91,nova_cell1:UPDATE=6 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:30.232385 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:30.241052 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-08545ae3-1d15-43cb-802b-7544bf02d06c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.192759 Aug 04 02:39:30.262839 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 198/375] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:30 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:31.114765 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:31.115478 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:31.115978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:31.116083 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:31.123839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:31.123839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:31.124370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:31.124550 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:31.124901 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:31.125014 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:31.125777 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:31.126216 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:31.281055 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:31.285850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:31.288974 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-24d55138-21a2-4cf8-96e5-73f7b3714549 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.178105 Aug 04 02:39:31.289554 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 199/376] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:31 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:31.294341 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:31.296614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:31.297795 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-aeece01e-dd4e-493f-9395-275b4ce4ae9d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.186961 Aug 04 02:39:31.306189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 178/377] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:31 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:31.322967 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:31.323625 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:31.330209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:31.330720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:31.331510 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:31.332016 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:31.483361 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:31.492888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-822ea767-f2fa-45be-a01a-50c12646f0e0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.184334 Aug 04 02:39:31.506925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 200/378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:31 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:32.315058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:32.315743 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:32.321909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:32.322474 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:32.322945 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:32.323254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:32.323714 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:32.324152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:32.330692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:32.331131 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:32.332002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:32.332353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:32.455708 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:32.463281 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b87b5488-7f13-4480-9877-269a9f1a30b8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.152829 Aug 04 02:39:32.463859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 179/379] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:32 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:32.464326 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:32.473155 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:32.474703 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:32.475856 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f7b1a710-8806-41d8-8784-6372a19d9555 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.157816 Aug 04 02:39:32.476414 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 201/380] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:32 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:32.515924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:32.516526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:32.522370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:32.522839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:32.523592 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:32.524018 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:32.652646 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:32.660899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f3646b09-d2b5-4ebd-8ab6-e5b0fcea47e6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.149251 Aug 04 02:39:32.661476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 180/381] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:32 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:33.486025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:33.487044 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:33.496648 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:33.497152 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:33.498791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:33.499623 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:33.506299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:33.507661 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:33.517382 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:33.518004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:33.518940 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:33.519446 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:33.546342 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:33.678876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:33.687648 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c6517c59-0c34-49cc-8bb6-57bcf126cb06 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.206428 Aug 04 02:39:33.689094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 202/382] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:33 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:33.695819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:33.696436 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:33.703502 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:33.704204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:33.705170 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:33.705771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:33.713832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:33.727407 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:33.729368 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:33.730824 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9cf1bf16-3848-4c2d-9fd9-9cdf0376849c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.235793 Aug 04 02:39:33.743060 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 181/383] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:33 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:33.867272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:33.880442 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3fad2d0b-4f91-48fe-8729-f42b7d7075b9 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.189949 Aug 04 02:39:33.881748 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 203/384] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:33 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:34.710023 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:34.711271 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:34.719036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:34.719462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:34.720447 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:34.721088 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:34.756081 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:34.757666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:34.764801 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:34.765509 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:34.766764 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:34.767698 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:34.912062 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:34.922540 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8978a38d-acae-4278-9a0c-454e4489fbfb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.215962 Aug 04 02:39:34.935610 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 182/385] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:34 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:34.939063 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:34.943952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:34.944569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:34.949498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:34.953609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:34.953767 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:34.953767 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:34.953979 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-32c6800d-decd-4baf-8e0f-98876797c68c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.201526 Aug 04 02:39:34.954076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:34.954630 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:34.971625 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 204/386] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:34 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:35.148414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:35.158377 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7fbc704f-1861-4478-9e29-bac7242e8491 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.221005 Aug 04 02:39:35.159020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 183/387] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:34 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:35.964173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:35.964173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:35.964173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:35.964173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:35.964822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:35.964822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:35.978311 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:35.979241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:35.986376 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:35.986984 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:35.987875 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:35.988377 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:36.160802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:36.167876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e3996d53-c688-4199-86d9-502f9c576d98 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.224697 Aug 04 02:39:36.180146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 205/388] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:35 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:36.190999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:36.191881 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:36.198346 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:36.198519 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:36.199143 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:36.199909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:36.200492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:36.207530 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:36.213744 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:36.215008 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2575d205-7b88-43dc-9cde-85105be52d34 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.240743 Aug 04 02:39:36.215778 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 184/389] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:35 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:36.411683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:36.423617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2db344b4-ab2c-4c33-b513-ff75c07b01de tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.236087 Aug 04 02:39:36.423617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 206/390] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:36 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:37.184121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1115435826", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1504962787", "security_groups": [{"name": "tempest-secgroup-smoke-2071859458"}], "networks": [{"uuid": "abbe6db3-adf6-4f5c-95d3-d11cdf2775a1"}], "block_device_mapping_v2": [{"uuid": "b32f3119-2609-4776-a5ff-ae36434058d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:37.203477 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:37.203477 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:37.208449 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:37.213786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.214426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.215576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.216322 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.349955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] validate_networks() for [('abbe6db3-adf6-4f5c-95d3-d11cdf2775a1', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:39:37.475546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:37.485842 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bd0a7a94-60c8-433e-9fdb-832e92712f66 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.293091 Aug 04 02:39:37.487289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 207/391] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:37 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:37.505859 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:37.508466 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:37.516017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.516554 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.517403 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.517837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.678908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:37.700484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:37.705476 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:37.706912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-542109d8-c2cf-4040-a875-dfdceff8784f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.217648 Aug 04 02:39:37.709315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 208/392] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:37 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:37.715507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:37.716333 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:37.723516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.724180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.725324 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.733471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.846434 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:39:37.847028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:39:37.848010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:39:37.848651 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:39:37.849497 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:39:37.861811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.863833 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.864872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:37.865527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:37.885954 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Getting quotas for project a49dcb863cd24a3cab8162c18ddf78f0. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:39:37.891641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Getting quotas for user 5091a0547e964c6d80b947191072e809 and project a49dcb863cd24a3cab8162c18ddf78f0. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:39:37.918739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:37.927332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7209c355-9e1c-4994-9b95-2d4afe4c0f23 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.215852 Aug 04 02:39:37.928106 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 209/393] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:37 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:37.978518 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:39:37.980887 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b32f3119-2609-4776-a5ff-ae36434058d4',volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:39:38.505962 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-414970f7-ec7a-4c16-9c64-fd783c33a519 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.326244 Aug 04 02:39:38.510676 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 185/394] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:39:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:39:38.510807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:38.510807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:38.518088 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-12b0739b-deae-4719-842d-cb3c7d51d520 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:38.519163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-12b0739b-deae-4719-842d-cb3c7d51d520 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:38.519396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:38.519910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:38.520864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:38.521482 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:38.577456 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-12b0739b-deae-4719-842d-cb3c7d51d520 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:38.584557 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-12b0739b-deae-4719-842d-cb3c7d51d520 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1089 microversion: 2.1 time: 0.070520 Aug 04 02:39:38.585596 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 186/395] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:38 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:38.683609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:38.693555 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-bd18739d-4583-4f97-b791-33a93b21798d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.187991 Aug 04 02:39:38.694388 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 210/396] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:38 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:38.736810 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:38.737516 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:38.751487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:38.758780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:38.758780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:38.758780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:38.912606 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:38.922637 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:38.924214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:38.925309 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-19de5fe8-0945-4e46-ad9e-c9536e9ba3a5 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.196027 Aug 04 02:39:38.926151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 187/397] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:38 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:38.948661 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:38.949271 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:38.955939 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:38.956394 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:38.957155 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:38.957591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:39.091060 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:39.099628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-01a0b40c-bb47-492c-8fb9-4ba5090407d7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.154747 Aug 04 02:39:39.100146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 211/398] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:38 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:39.605675 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fdf4c6af-d5f0-4c00-9d76-98aa7320c002 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:39.606281 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fdf4c6af-d5f0-4c00-9d76-98aa7320c002 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:39.608770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:39.665015 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fdf4c6af-d5f0-4c00-9d76-98aa7320c002 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:39.672524 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fdf4c6af-d5f0-4c00-9d76-98aa7320c002 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1089 microversion: 2.1 time: 0.070744 Aug 04 02:39:39.676430 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 188/399] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:39 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:39.714465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:39.715094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:39.722688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:39.723136 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:39.723906 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:39.724343 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:39.865168 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:39.872747 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2ddd3b81-6554-4a66-a95c-b67b174838ec tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.162207 Aug 04 02:39:39.873785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 212/400] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:39 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:39.949301 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:39.950020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:39.957955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:39.958409 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:39.959252 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:39.959698 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:40.101952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:40.110950 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:40.112558 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:40.113723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-747b4287-3d9a-4ac2-adf1-6f962ec1863d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.168764 Aug 04 02:39:40.114285 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 189/401] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:39 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:40.124255 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:40.125601 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:40.133315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:40.134048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:40.134958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:40.135615 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:40.300282 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:40.308795 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4d14ab61-806a-4d55-ab76-dc8009c15f6d tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.191450 Aug 04 02:39:40.325006 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 213/402] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:40 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:40.693111 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:40.693816 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:40.700224 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:40.700671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:40.702084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:40.702538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:40.894780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:40.896198 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:40.903336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:40.904779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:40.907933 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:40.908578 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:41.017844 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:41.026007 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a73e58ca-29ac-464a-ad29-27e5c608bdca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1187 microversion: 2.1 time: 0.336786 Aug 04 02:39:41.026761 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 190/403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:40 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1187 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:41.078369 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:41.082190 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=100 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:41.086919 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-55942bb5-144b-4971-81f5-2d38d0d6023f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.196090 Aug 04 02:39:41.087498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 214/404] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:40 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:41.138171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:41.139899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:41.149285 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:41.150379 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:41.151954 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:41.152633 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:41.298047 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:41.306896 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:41.308398 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:41.309556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4c556dfb-82cb-4043-8e07-80b91605eb1a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.176035 Aug 04 02:39:41.310117 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 191/405] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:41 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:41.333943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:41.334617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:41.340828 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:41.341276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:41.342075 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:41.342631 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:41.529851 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:41.540285 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f6a1add5-f8b6-430e-9729-86d90a915f8e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.210726 Aug 04 02:39:41.541735 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 215/406] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:41 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:42.053486 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:42.054271 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:42.062004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.062632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.063534 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.064067 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.111581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:42.111581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:42.128213 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.128506 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.135975 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.136632 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.227729 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:42.241829 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4d9aaa3d-df98-4bae-8dba-f4eb408da79e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1273 microversion: 2.1 time: 0.194391 Aug 04 02:39:42.249887 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 192/407] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:42 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:42.310372 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:42.318910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-62bb4e32-2879-4b3e-8681-e4092b228918 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1677 microversion: 2.1 time: 0.214507 Aug 04 02:39:42.323899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 216/408] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:42 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:42.338648 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:42.339433 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:42.345600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.349629 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.349629 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.349629 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.514247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:42.524857 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:42.530500 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:42.530500 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-783204eb-a258-45ca-a7fc-044ad3abf96f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.193451 Aug 04 02:39:42.538786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 193/409] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:42 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:42.563176 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:42.563712 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:42.569808 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.570263 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.571318 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:42.571838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:42.796227 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:42.805079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b5b41536-83e4-4150-bd16-be45251c43b5 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.245935 Aug 04 02:39:42.805658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 217/410] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:42 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:43.204831 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-264de792-2064-43ea-9db5-22f1be133ca4 req-7a297f6d-490d-4050-8a8e-dad9593a289b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680f726e-1314-4d14-a8e1-1752f6efc2f3", "tag": "297fbec7-3f62-4364-b1a7-6b0b689eede7"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:43.216760 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-264de792-2064-43ea-9db5-22f1be133ca4 req-7a297f6d-490d-4050-8a8e-dad9593a289b service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.217421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-264de792-2064-43ea-9db5-22f1be133ca4 req-7a297f6d-490d-4050-8a8e-dad9593a289b service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.229538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-264de792-2064-43ea-9db5-22f1be133ca4 req-7a297f6d-490d-4050-8a8e-dad9593a289b service nova] Creating event network-changed:297fbec7-3f62-4364-b1a7-6b0b689eede7 for instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 on hv-cinder-74014 Aug 04 02:39:43.235342 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-264de792-2064-43ea-9db5-22f1be133ca4 req-7a297f6d-490d-4050-8a8e-dad9593a289b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Aug 04 02:39:43.235997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 194/411] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:39:43.265379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:43.265990 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:43.272990 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.273451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.274222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.274870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.343480 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:43.344174 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:43.350592 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.351107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.351875 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.352305 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.486870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:43.488550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:43.494868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0bdf0900-9d1e-42cc-b366-33b174589655 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.233472 Aug 04 02:39:43.495994 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 218/412] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:43 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:43.496573 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f3cc6906-26b8-4eb2-aeac-27ebee1406c3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1654 microversion: 2.1 time: 0.159476 Aug 04 02:39:43.497179 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 195/413] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:43 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:43.518269 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4d24bc50-468c-4c16-93c4-933064ef8ff1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:43.524844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4d24bc50-468c-4c16-93c4-933064ef8ff1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.525295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4d24bc50-468c-4c16-93c4-933064ef8ff1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.548339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4d24bc50-468c-4c16-93c4-933064ef8ff1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Going to try to start instance {{(pid=124997) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 02:39:43.552878 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:43.553863 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:43.564524 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.565121 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.565988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.566538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.680115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4d24bc50-468c-4c16-93c4-933064ef8ff1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.166489 Aug 04 02:39:43.680724 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 219/414] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:39:43 2022] POST /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:39:43.690416 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:43.691381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:43.697893 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.698660 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.699606 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.700397 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.739764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:43.750289 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:43.752564 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:43.753775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3add6b87-b49e-48a3-b0a1-7e2b0145e994 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.205077 Aug 04 02:39:43.754339 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 196/415] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:43 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:43.828878 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:43.829491 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:43.836033 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.839203 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.840293 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:43.843013 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:43.924329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:43.931982 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5cc8c2fc-d28c-46d6-baa3-ae2376a7ce22 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1663 microversion: 2.1 time: 0.246433 Aug 04 02:39:43.932771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 220/416] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:43 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1663 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:44.093411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:44.101912 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e3628f1a-afc3-4343-a0b1-f4c2564b48fc tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.276909 Aug 04 02:39:44.102521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 197/417] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:43 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:44.516799 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:44.517408 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:44.524053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-0de01ece-a2e4-4600-af68-a1d094e1e9f3 req-1a8c7654-4663-4c03-9d28-ca450837505e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fb61ca-19be-4d4c-a340-ec997691ac10", "name": "network-vif-plugged", "status": "completed", "tag": "47529bd5-9d31-4f9f-8fd1-96a64c939a51"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:44.525224 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:44.526737 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:44.528426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:44.530011 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:44.535359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-0de01ece-a2e4-4600-af68-a1d094e1e9f3 req-1a8c7654-4663-4c03-9d28-ca450837505e service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:44.535798 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-0de01ece-a2e4-4600-af68-a1d094e1e9f3 req-1a8c7654-4663-4c03-9d28-ca450837505e service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:44.548033 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-0de01ece-a2e4-4600-af68-a1d094e1e9f3 req-1a8c7654-4663-4c03-9d28-ca450837505e service nova] Creating event network-vif-plugged:47529bd5-9d31-4f9f-8fd1-96a64c939a51 for instance 88fb61ca-19be-4d4c-a340-ec997691ac10 on hv-cinder-74014 Aug 04 02:39:44.554208 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-0de01ece-a2e4-4600-af68-a1d094e1e9f3 req-1a8c7654-4663-4c03-9d28-ca450837505e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034057 Aug 04 02:39:44.554990 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 198/418] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:39:44.671169 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:44.678780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5919b141-81db-4510-86f5-8c05d4c4c650 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.166303 Aug 04 02:39:44.679365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 221/419] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:44 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:44.778156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:44.779863 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:44.786230 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:44.786712 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:44.787509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:44.787927 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:44.925203 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:44.934753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:44.936372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:44.937572 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ae0ccf45-9b72-46d0-9bd0-71d266050cad tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.164070 Aug 04 02:39:44.938145 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 199/420] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:44 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:44.954239 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:44.954922 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:44.961163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:44.961623 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:44.962390 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:44.962885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:45.094639 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:45.102852 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-23a10ae8-f40c-4046-9080-624a24272e16 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1663 microversion: 2.1 time: 0.153506 Aug 04 02:39:45.103420 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 222/421] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:44 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:45.124860 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:45.125467 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:45.131919 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:45.132346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:45.133107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:45.133545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:45.306537 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:45.315764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f8d1a5c1-7ed3-464a-9230-d34e34714da0 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.195253 Aug 04 02:39:45.319171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 200/422] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:45 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:45.699391 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:45.700133 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:45.706799 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:45.707322 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:45.708220 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:45.708656 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:45.961078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:45.961692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:45.968959 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:45.969412 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:45.970186 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:45.970655 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:46.067397 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:46.075691 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d7998ba2-3772-4d38-99ba-2a99df1a6eee tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.380080 Aug 04 02:39:46.077027 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 223/423] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:45 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:46.109018 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:46.117652 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:46.119205 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:46.120403 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8fc9ab19-bf5e-44d0-b5a1-67d30741d5f1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.163345 Aug 04 02:39:46.120963 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 201/424] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:45 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:46.125741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:46.126353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:46.133639 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:46.134140 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:46.134931 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:46.135358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:46.270614 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:46.278230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-21326e67-54bc-442e-b05e-f4a7d4c177c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1663 microversion: 2.1 time: 0.157178 Aug 04 02:39:46.279118 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 224/425] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:46 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:46.337967 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:46.338607 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:46.344801 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:46.345248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:46.346010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:46.346449 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:46.350450 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=100 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:46.486426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:46.494987 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-870d9fdd-db49-43fa-9f2a-2783a70c2912 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.161072 Aug 04 02:39:46.495566 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 202/426] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:46 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:47.098327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:47.099644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:47.107413 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.107958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.109751 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.110193 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.146649 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:47.147272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:47.154076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.155020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.155827 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.160218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.261462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:47.270819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4710fec6-d6f5-476d-9d79-344a8d990e70 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.176215 Aug 04 02:39:47.271119 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 225/427] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:47 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:47.300513 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:47.303128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:47.307402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.307851 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.308648 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.309256 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.309613 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:47.319508 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:47.321094 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:47.322301 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c2600f58-b741-4bc5-be37-670bdaf554d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.181011 Aug 04 02:39:47.327370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 203/428] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:47 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:47.448770 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:47.457212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d53d9c46-9010-4557-a1ab-1177f1221dbb tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1667 microversion: 2.1 time: 0.160860 Aug 04 02:39:47.457810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 226/429] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:47 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:47.517132 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:47.517683 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:47.523745 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.524271 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.524978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:47.525415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:47.665119 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:47.673684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-432a0647-1122-400a-92e7-fa17f73bd33e tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.161298 Aug 04 02:39:47.674242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 204/430] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:47 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:48.292679 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:48.293226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:48.299978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:48.300428 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:48.301187 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:48.301626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:48.350386 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:48.351021 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:48.352872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:48.358333 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:48.359979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:48.359979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:48.359979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:48.446220 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:48.453797 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5b37fc5a-bc13-4970-84fb-35dee7630760 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.165043 Aug 04 02:39:48.454365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 227/431] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:48 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:48.505794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:48.515087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:48.516791 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:48.517990 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1c819cf7-1f13-49f3-9af6-4b4f2c68209a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.171636 Aug 04 02:39:48.518575 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 205/432] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:48 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:48.608366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-e48ad82b-6c18-4e4b-985b-cd95e462d533 req-c819c108-122c-4ccd-bff5-6f5b0c41a0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680f726e-1314-4d14-a8e1-1752f6efc2f3", "name": "network-vif-plugged", "status": "completed", "tag": "297fbec7-3f62-4364-b1a7-6b0b689eede7"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:48.622084 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e48ad82b-6c18-4e4b-985b-cd95e462d533 req-c819c108-122c-4ccd-bff5-6f5b0c41a0b5 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:48.622689 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e48ad82b-6c18-4e4b-985b-cd95e462d533 req-c819c108-122c-4ccd-bff5-6f5b0c41a0b5 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:48.634901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-e48ad82b-6c18-4e4b-985b-cd95e462d533 req-c819c108-122c-4ccd-bff5-6f5b0c41a0b5 service nova] Creating event network-vif-plugged:297fbec7-3f62-4364-b1a7-6b0b689eede7 for instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 on hv-cinder-74014 Aug 04 02:39:48.640089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-e48ad82b-6c18-4e4b-985b-cd95e462d533 req-c819c108-122c-4ccd-bff5-6f5b0c41a0b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036108 Aug 04 02:39:48.640613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 228/433] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:39:48.695375 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:48.697725 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:48.704356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:48.704802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:48.705572 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:48.706185 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:48.854509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:48.863609 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ea0b2b8f-daeb-49bc-b7e9-4b512c9c9436 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1736 microversion: 2.1 time: 0.172123 Aug 04 02:39:48.864194 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 206/434] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:48 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:49.476109 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:49.476794 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:49.483252 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:49.486335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:49.486335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:49.486335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:49.542882 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:49.543796 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:49.552499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:49.553034 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:49.553879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:49.554413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:49.654910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:49.666867 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8596fd6f-25f2-40aa-a974-fb655c9225d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.195427 Aug 04 02:39:49.668623 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=10 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:49.676664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 229/435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:49 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:49.718043 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:49.726535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:49.728070 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:49.732103 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7c11d7d2-f1d8-480f-96cc-48e49a70d3fb tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1809 microversion: 2.20 time: 0.191255 Aug 04 02:39:49.732103 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 207/436] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:49 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:39:49.885883 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:49.886535 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:49.893455 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:49.893990 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:49.894933 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:49.895374 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.069251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:50.084929 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5ddcbbd6-1282-45aa-876e-bb81f4cbb9fb tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1716 microversion: 2.1 time: 0.196501 Aug 04 02:39:50.084929 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 230/437] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:49 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1716 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:50.196715 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:50.197245 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:50.203949 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.204445 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.205257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.205693 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.288718 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] HTTP exception thrown: Cannot 'detach_volume' instance bab20e5a-df8f-4361-b521-1f38b500844d while it is in vm_state rescued Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Request method failure captured: Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments/b58dddee-6262-4cf2-9c71-b9807eb315dc HTTP/1.1 Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDAI5xZasBc4s9WNuv-Qjf7mITTZ5lofTJ84BXtJolx_So_G1w3wwpOMpl3Ud6-qvV-S0_XwYZPQQkDLIuw3gL_ck-uTgi-lNyYs9qCsxkLmyFSwSjjnLuIMcxj6MZ_bexxe72bIS1t_rK_UW24TwWGL1CWugMmQZ3f2Dqaf-0OGJ8 Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:39:50.290237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_651f296b94d342488b3cd98998a08e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/651f296b94d342488b3cd98998a08e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 2e47969dca184aec92e620fcd53d6a5c Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:39:50.291685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Cannot 'detach_volume' instance bab20e5a-df8f-4361-b521-1f38b500844d while it is in vm_state rescued Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'server_id': 'bab20e5a-df8f-4361-b521-1f38b500844d', 'id': 'b58dddee-6262-4cf2-9c71-b9807eb315dc'} Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bab20e5a-df8f-4361-b521-1f38b500844d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:39:50.292359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bab20e5a-df8f-4361-b521-1f38b500844d while it is in vm_state rescued Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bab20e5a-df8f-4361-b521-1f38b500844d while it is in vm_state rescued Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:39:50.293591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Returning 409 to user: Cannot 'detach_volume' instance bab20e5a-df8f-4361-b521-1f38b500844d while it is in vm_state rescued {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:39:50.294586 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1dfcfd23-ccfc-41e9-9d49-6fe14396a91a tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments/b58dddee-6262-4cf2-9c71-b9807eb315dc" status: 409 len: 152 microversion: 2.1 time: 0.099969 Aug 04 02:39:50.294586 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 208/438] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:39:50 2022] DELETE /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments/b58dddee-6262-4cf2-9c71-b9807eb315dc => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 02:39:50.302498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-67fb3fd1-02e1-4183-807d-fd2454426979 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:50.303068 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-67fb3fd1-02e1-4183-807d-fd2454426979 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:50.309360 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67fb3fd1-02e1-4183-807d-fd2454426979 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.309808 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67fb3fd1-02e1-4183-807d-fd2454426979 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.310590 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67fb3fd1-02e1-4183-807d-fd2454426979 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.311038 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-67fb3fd1-02e1-4183-807d-fd2454426979 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.315332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:50.490387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-67fb3fd1-02e1-4183-807d-fd2454426979 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "POST /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/action" status: 202 len: 0 microversion: 2.1 time: 0.191927 Aug 04 02:39:50.491050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 231/439] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:39:50 2022] POST /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:39:50.499692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:50.500496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:50.506623 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.507074 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.507862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.508298 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.640706 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:50.648699 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b87ddb78-83c3-4c12-8888-aa1981b78c74 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1724 microversion: 2.1 time: 0.153291 Aug 04 02:39:50.649264 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 209/440] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:50 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:50.689997 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:50.690750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:50.696844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.697289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.698037 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.698466 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.753433 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:50.754030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:50.759964 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.760417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.761165 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:50.761595 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:50.834776 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:50.847692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-74dc5f49-3774-4f5b-8a2b-3f42ce02e232 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.157632 Aug 04 02:39:50.847692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 232/441] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:50 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:50.894367 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:50.902947 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:50.904712 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:50.905939 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ae62555d-5756-47c4-9464-2ff95ce8e3dd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1796 microversion: 2.20 time: 0.157177 Aug 04 02:39:50.906538 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 210/442] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:39:50 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:39:51.670313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:51.670952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:51.677425 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:51.677886 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:51.678675 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:51.679119 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:51.863679 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:51.864293 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:51.871302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:51.872424 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:51.873201 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:51.873667 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:51.875786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:51.884492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5e7616d3-878b-4b8a-be35-e8994dbff613 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1724 microversion: 2.1 time: 0.218041 Aug 04 02:39:51.885375 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 233/443] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:51 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:52.035612 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:52.043589 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a6bcc215-b741-4120-b8f4-64919b8dbb7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1261 microversion: 2.1 time: 0.183823 Aug 04 02:39:52.044378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 211/444] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:51 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:39:52.905793 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:52.907027 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:52.913493 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:52.913941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:52.914731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:52.915169 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:53.047863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:53.055905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2e4db7e4-b348-4e93-b23d-60fd48ff0038 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1724 microversion: 2.1 time: 0.154278 Aug 04 02:39:53.056464 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 234/445] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:52 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:53.063595 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:53.064345 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:53.071122 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:53.071599 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:53.072362 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:53.072794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:53.209501 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:53.217136 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0cc1b942-66f9-429f-944d-c20d1bed3688 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1444 microversion: 2.1 time: 0.157356 Aug 04 02:39:53.219270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 212/446] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:53 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:53.237419 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:53.238032 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:53.244110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:53.244561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:53.245323 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:53.245760 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:53.376105 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:53.383780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-53e81558-6e2a-4fae-954d-64c9c51045cf tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1444 microversion: 2.1 time: 0.150405 Aug 04 02:39:53.384512 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 235/447] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:53 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:54.077484 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:54.078274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:54.084639 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:54.085190 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:54.086097 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:54.086862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:54.225766 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:54.234056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f52854cb-01be-4d2b-a04c-a0f0a8d12116 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1724 microversion: 2.1 time: 0.160718 Aug 04 02:39:54.234782 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 213/448] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:54 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:55.256812 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:55.257428 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:55.263998 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:55.264462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:55.265750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:55.266232 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:55.692350 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:39:55.700392 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7b574060-343f-4b7e-8363-989c43f16701 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1730 microversion: 2.1 time: 0.447683 Aug 04 02:39:55.700965 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 236/449] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:39:55 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1730 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:39:55.721773 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2242a4c6-52ed-4b2c-ad31-b8fd4f432d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:39:55.722290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2242a4c6-52ed-4b2c-ad31-b8fd4f432d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:39:55.728540 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2242a4c6-52ed-4b2c-ad31-b8fd4f432d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:55.728985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2242a4c6-52ed-4b2c-ad31-b8fd4f432d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:55.729738 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2242a4c6-52ed-4b2c-ad31-b8fd4f432d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:55.730171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2242a4c6-52ed-4b2c-ad31-b8fd4f432d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:55.793464 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-83285933-1679-44e4-9c9a-ee0a2ec19bef req-3c835e38-4b51-4f56-9cdc-ebb99fba60e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680f726e-1314-4d14-a8e1-1752f6efc2f3", "tag": "297fbec7-3f62-4364-b1a7-6b0b689eede7"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:55.803431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-83285933-1679-44e4-9c9a-ee0a2ec19bef req-3c835e38-4b51-4f56-9cdc-ebb99fba60e0 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:55.803952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-83285933-1679-44e4-9c9a-ee0a2ec19bef req-3c835e38-4b51-4f56-9cdc-ebb99fba60e0 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:55.817286 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-83285933-1679-44e4-9c9a-ee0a2ec19bef req-3c835e38-4b51-4f56-9cdc-ebb99fba60e0 service nova] Creating event network-changed:297fbec7-3f62-4364-b1a7-6b0b689eede7 for instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 on hv-cinder-74014 Aug 04 02:39:55.822727 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-83285933-1679-44e4-9c9a-ee0a2ec19bef req-3c835e38-4b51-4f56-9cdc-ebb99fba60e0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033089 Aug 04 02:39:55.823616 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 237/450] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:39:55.833100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2242a4c6-52ed-4b2c-ad31-b8fd4f432d41 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115373 Aug 04 02:39:55.833728 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 214/451] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:39:55 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:39:57.838913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-68e4b736-5fe8-41d1-8186-4fa328f3e954 req-fc973fb9-2b31-47e3-ab70-556d11fbba6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab20e5a-df8f-4361-b521-1f38b500844d", "tag": "43e8622c-a7b9-4fda-95ee-56ab8dbaf238"}, {"name": "network-changed", "server_uuid": "bab20e5a-df8f-4361-b521-1f38b500844d", "tag": "43e8622c-a7b9-4fda-95ee-56ab8dbaf238"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:39:57.849882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-68e4b736-5fe8-41d1-8186-4fa328f3e954 req-fc973fb9-2b31-47e3-ab70-556d11fbba6a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:39:57.850363 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-68e4b736-5fe8-41d1-8186-4fa328f3e954 req-fc973fb9-2b31-47e3-ab70-556d11fbba6a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:39:57.863192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-68e4b736-5fe8-41d1-8186-4fa328f3e954 req-fc973fb9-2b31-47e3-ab70-556d11fbba6a service nova] Creating event network-changed:43e8622c-a7b9-4fda-95ee-56ab8dbaf238 for instance bab20e5a-df8f-4361-b521-1f38b500844d on hv-cinder-74014 Aug 04 02:39:57.863762 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-68e4b736-5fe8-41d1-8186-4fa328f3e954 req-fc973fb9-2b31-47e3-ab70-556d11fbba6a service nova] Creating event network-changed:43e8622c-a7b9-4fda-95ee-56ab8dbaf238 for instance bab20e5a-df8f-4361-b521-1f38b500844d on hv-cinder-74014 Aug 04 02:39:57.868945 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-68e4b736-5fe8-41d1-8186-4fa328f3e954 req-fc973fb9-2b31-47e3-ab70-556d11fbba6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034227 Aug 04 02:39:57.870771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 238/452] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:10.299084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=55 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:10.299794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=74 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:10.303636 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-88642142", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:10.357262 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] validate_networks() for None {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:40:10.628294 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:40:10.628722 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:40:10.629194 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:40:10.629603 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:40:10.630014 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:40:10.639755 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:10.640262 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:10.641068 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:10.641501 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:10.659016 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Getting quotas for project 6b0b28cbffb04bd98552c26685e674ab. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:40:10.662955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Getting quotas for user 9e727894025848fa9aceed55e83f85dc and project 6b0b28cbffb04bd98552c26685e674ab. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:40:10.673719 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:40:10.676021 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:40:10.808480 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bba5ca62-83fc-492f-a70a-32d81da60572 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510859 Aug 04 02:40:10.809380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 215/453] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:40:10.818706 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=63 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:10.819471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:10.823518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3d9d59bb-4ab7-4efc-87ab-e6748c54288f tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:10.824219 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3d9d59bb-4ab7-4efc-87ab-e6748c54288f tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:10.879466 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3d9d59bb-4ab7-4efc-87ab-e6748c54288f tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:10.886061 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3d9d59bb-4ab7-4efc-87ab-e6748c54288f tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1213 microversion: 2.1 time: 0.069078 Aug 04 02:40:10.888288 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 239/454] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:10 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:11.907971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:11.909406 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:11.915569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:11.916012 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:11.916816 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:11.917227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:11.977752 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:11.985166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-150668a6-8fdb-4bb0-87cc-74cd8e2d2855 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1217 microversion: 2.1 time: 0.081897 Aug 04 02:40:11.985727 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 216/455] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:11 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:40:13.006293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:13.006982 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:13.014363 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:13.014837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:13.015603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:13.016037 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:13.103905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:13.111405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ce357faf-c428-4f60-a1c2-21b5912785c1 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1273 microversion: 2.1 time: 0.110033 Aug 04 02:40:13.112417 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 240/456] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:13 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:14.139432 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:14.141914 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:14.147042 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:14.147445 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:14.148306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:14.148748 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:14.285678 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:14.293110 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-77777f60-e259-43f1-b091-3ac2bf8dfe9e tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.157592 Aug 04 02:40:14.293681 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 217/457] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:14 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:14.663530 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-b8ae639f-12d5-4ac0-8e22-090cd95b83e6 req-2aa1dbb1-7a8a-464e-a763-6cd32ec1ede2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9304d1-ae6c-4c56-84de-183548b62753", "tag": "93f9ac61-aa86-421b-8085-02852f7af63b"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:14.674764 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-b8ae639f-12d5-4ac0-8e22-090cd95b83e6 req-2aa1dbb1-7a8a-464e-a763-6cd32ec1ede2 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:14.675215 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-b8ae639f-12d5-4ac0-8e22-090cd95b83e6 req-2aa1dbb1-7a8a-464e-a763-6cd32ec1ede2 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:14.686580 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-b8ae639f-12d5-4ac0-8e22-090cd95b83e6 req-2aa1dbb1-7a8a-464e-a763-6cd32ec1ede2 service nova] Creating event network-changed:93f9ac61-aa86-421b-8085-02852f7af63b for instance 4f9304d1-ae6c-4c56-84de-183548b62753 on hv-cinder-74014 Aug 04 02:40:14.692272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-b8ae639f-12d5-4ac0-8e22-090cd95b83e6 req-2aa1dbb1-7a8a-464e-a763-6cd32ec1ede2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032853 Aug 04 02:40:14.692863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 241/458] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:15.314265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:15.318192 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:15.321708 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:15.322150 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:15.322941 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:15.323374 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:15.459811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:15.467246 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3d753ced-1a26-4b45-8835-6aad0abea129 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.156884 Aug 04 02:40:15.467812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 218/459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:15 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:16.490191 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:16.490921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:16.497070 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:16.497510 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:16.498266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:16.498726 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:16.625181 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:16.632831 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d6889f1d-f41c-4905-b3e4-690cf0bd8f51 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.148127 Aug 04 02:40:16.633436 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 242/460] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:16 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:17.653565 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:17.654351 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:17.660818 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:17.661264 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:17.662019 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:17.662451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:17.791604 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:17.799481 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-93c2061e-1860-4720-a394-c2e814f3b82b tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.149328 Aug 04 02:40:17.800102 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 219/461] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:17 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:18.820524 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:18.821243 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:18.827581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:18.828023 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:18.828783 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:18.829211 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:18.955404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:18.963366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0f2a341f-77ca-48f9-a831-3fe767d9e68c tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.147305 Aug 04 02:40:18.963926 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 243/462] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:18 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:19.984251 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:19.984852 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:19.991310 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:19.991750 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:19.992594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:19.993025 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:20.122417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:20.129899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f379f73c-0891-46d8-b00b-8946901ac23d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.149656 Aug 04 02:40:20.130467 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 220/463] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:19 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:20.757130 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-8da717b4-f2a4-4702-a431-2d6f17a2a4c1 req-3df0f95f-aa08-48b1-889c-53010472f27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9304d1-ae6c-4c56-84de-183548b62753", "name": "network-vif-plugged", "status": "completed", "tag": "93f9ac61-aa86-421b-8085-02852f7af63b"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:20.767009 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-8da717b4-f2a4-4702-a431-2d6f17a2a4c1 req-3df0f95f-aa08-48b1-889c-53010472f27d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:20.768864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-8da717b4-f2a4-4702-a431-2d6f17a2a4c1 req-3df0f95f-aa08-48b1-889c-53010472f27d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:20.780015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-8da717b4-f2a4-4702-a431-2d6f17a2a4c1 req-3df0f95f-aa08-48b1-889c-53010472f27d service nova] Creating event network-vif-plugged:93f9ac61-aa86-421b-8085-02852f7af63b for instance 4f9304d1-ae6c-4c56-84de-183548b62753 on hv-cinder-74014 Aug 04 02:40:20.785225 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-8da717b4-f2a4-4702-a431-2d6f17a2a4c1 req-3df0f95f-aa08-48b1-889c-53010472f27d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032271 Aug 04 02:40:20.785822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 244/464] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:21.150001 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:21.150650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:21.152477 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:21.153157 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=6 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:21.158694 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:21.159290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:21.160065 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:21.160505 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:21.292161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:21.302794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b632c508-20c5-4bf3-b834-4d1dec7bf875 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.153589 Aug 04 02:40:21.302794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 221/465] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:21 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:22.318442 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:22.323014 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:22.323714 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:22.329873 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:22.330321 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:22.331246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:22.331567 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:22.462447 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:22.469959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ea36d99b-be47-4e2a-be08-56b0cc68c114 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1313 microversion: 2.1 time: 0.153164 Aug 04 02:40:22.470611 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 245/466] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:22 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:23.491507 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:23.492122 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:23.498299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:23.498777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:23.499543 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:23.499981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:23.628383 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:23.636337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a8c88dc8-0a69-43e4-8288-e520d3399fc9 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1462 microversion: 2.1 time: 0.149228 Aug 04 02:40:23.636895 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 222/467] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:23 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1462 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:23.681145 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:23.681670 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:23.688063 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:23.688516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:23.689272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:23.689711 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:23.723448 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:40:24.001609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c33458ce-6fe4-45b4-a214-92fe5b988bed tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 204 len: 0 microversion: 2.1 time: 0.324697 Aug 04 02:40:24.002196 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 246/468] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:40:23 2022] DELETE /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:40:24.010267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:24.010942 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:24.016946 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:24.017389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:24.018143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:24.018621 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:24.147251 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:24.154983 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fc0476ee-477a-4b54-ae51-02f378625a7d tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1468 microversion: 2.1 time: 0.148587 Aug 04 02:40:24.155551 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 223/469] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:24 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1468 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:25.176951 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:25.177849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:25.184104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:25.188033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:25.188033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:25.188033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:25.319454 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:25.326923 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b0332a0e-ced5-49f2-b4f6-d5922804ff18 tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1468 microversion: 2.1 time: 0.154871 Aug 04 02:40:25.327491 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 247/470] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:25 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:40:26.252168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-71c640ee-e755-49a6-8146-a6d5ba12b6b5 req-24ebce36-a6e4-4814-b662-d9d63c38c55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9304d1-ae6c-4c56-84de-183548b62753", "name": "network-vif-deleted", "tag": "93f9ac61-aa86-421b-8085-02852f7af63b"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:26.263279 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-71c640ee-e755-49a6-8146-a6d5ba12b6b5 req-24ebce36-a6e4-4814-b662-d9d63c38c55c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:26.263723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-71c640ee-e755-49a6-8146-a6d5ba12b6b5 req-24ebce36-a6e4-4814-b662-d9d63c38c55c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:26.276425 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-71c640ee-e755-49a6-8146-a6d5ba12b6b5 req-24ebce36-a6e4-4814-b662-d9d63c38c55c service nova] Creating event network-vif-deleted:93f9ac61-aa86-421b-8085-02852f7af63b for instance 4f9304d1-ae6c-4c56-84de-183548b62753 on hv-cinder-74014 Aug 04 02:40:26.281878 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-71c640ee-e755-49a6-8146-a6d5ba12b6b5 req-24ebce36-a6e4-4814-b662-d9d63c38c55c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 Aug 04 02:40:26.282509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 224/471] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:26.347929 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:26.348584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:26.355594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:26.356067 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:26.356908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:26.357350 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:26.420548 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e727894025848fa9aceed55e83f85dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0b28cbffb04bd98552c26685e674ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:26.428821 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a99653b4-1e8b-4251-9f32-7357ad5e466a tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 200 len: 1426 microversion: 2.1 time: 0.084738 Aug 04 02:40:26.429507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 248/472] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:26 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:27.450935 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:27.451635 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] [instance: 4f9304d1-ae6c-4c56-84de-183548b62753] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:27.458632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:27.459093 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:27.459899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:27.460335 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:27.473356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] HTTP exception thrown: Instance 4f9304d1-ae6c-4c56-84de-183548b62753 could not be found. Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Request method failure captured: Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 HTTP/1.1 Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zGI8U6R50LhQR08ZBH-41HVmQKJAeoNvcEqKnKzcyaQVxHxptDM8FLLcfZ-KZBvuR4DsVMIpNTNTwEoNDDHYEdCPUfAXYsiH3rQw2D-iRXS6o9GoN8q4kufqROp3lxCGIrXiCZlcvBIIRJXKRQPSRD_Foq2KBWZWfYmubTFlz0vBbo Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 6b0b28cbffb04bd98552c26685e674ab Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesNegativeTest-475510071 Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:40:27.475802 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b0b28cbffb04bd98552c26685e674ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b0b28cbffb04bd98552c26685e674ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b0b28cbffb04bd98552c26685e674ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b0b28cbffb04bd98552c26685e674ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesNegativeTest-475510071 Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 6b0b28cbffb04bd98552c26685e674ab Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesNegativeTest-475510071 Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesNegativeTest-475510071-project Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 9e727894025848fa9aceed55e83f85dc Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesNegativeTest-475510071-project Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 4f9304d1-ae6c-4c56-84de-183548b62753 could not be found. Aug 04 02:40:27.477337 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '4f9304d1-ae6c-4c56-84de-183548b62753'} Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9304d1-ae6c-4c56-84de-183548b62753 could not be found. Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:40:27.478250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9304d1-ae6c-4c56-84de-183548b62753 could not be found. Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9304d1-ae6c-4c56-84de-183548b62753 could not be found. Aug 04 02:40:27.479749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:27.481136 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] Returning 404 to user: Instance 4f9304d1-ae6c-4c56-84de-183548b62753 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:40:27.481136 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-212a7f4c-b8a0-47be-8540-7fe42f1573ca tempest-VolumesNegativeTest-475510071 tempest-VolumesNegativeTest-475510071-project] 10.222.0.60 "GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753" status: 404 len: 111 microversion: 2.1 time: 0.031163 Aug 04 02:40:27.481136 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 225/473] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:27 2022] GET /compute/v2.1/servers/4f9304d1-ae6c-4c56-84de-183548b62753 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:33.049716 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-26e4ae42-e768-45ef-9a88-5a740100877b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:33.050205 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-26e4ae42-e768-45ef-9a88-5a740100877b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:33.056587 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26e4ae42-e768-45ef-9a88-5a740100877b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:33.057038 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26e4ae42-e768-45ef-9a88-5a740100877b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:33.058015 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26e4ae42-e768-45ef-9a88-5a740100877b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:33.058454 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26e4ae42-e768-45ef-9a88-5a740100877b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:33.091302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-26e4ae42-e768-45ef-9a88-5a740100877b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments/f7f3f9ab-d4b4-420b-818a-5d1c9a8e7a5c" status: 200 len: 194 microversion: 2.20 time: 0.045285 Aug 04 02:40:33.091914 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 249/474] 10.222.0.60 () {60 vars in 1454 bytes} [Thu Aug 4 02:40:33 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments/f7f3f9ab-d4b4-420b-818a-5d1c9a8e7a5c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:40:33.169141 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:33.169688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:33.176640 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:33.177240 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:33.178028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:33.178675 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:33.264072 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lazy-loading 'services' on Instance uuid 88fb61ca-19be-4d4c-a340-ec997691ac10 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:40:33.641205 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3ad738f5-8f63-403b-a5e1-6bc531d7c1c6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments/f7f3f9ab-d4b4-420b-818a-5d1c9a8e7a5c" status: 202 len: 0 microversion: 2.20 time: 0.475857 Aug 04 02:40:33.645250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 226/475] 10.222.0.60 () {60 vars in 1457 bytes} [Thu Aug 4 02:40:33 2022] DELETE /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments/f7f3f9ab-d4b4-420b-818a-5d1c9a8e7a5c => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:40:33.652255 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-79fedabe-3831-4c51-9231-4d72bb408b48 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:33.654979 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-79fedabe-3831-4c51-9231-4d72bb408b48 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:33.662462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79fedabe-3831-4c51-9231-4d72bb408b48 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:33.662941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79fedabe-3831-4c51-9231-4d72bb408b48 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:33.663820 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79fedabe-3831-4c51-9231-4d72bb408b48 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:33.664249 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-79fedabe-3831-4c51-9231-4d72bb408b48 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:33.694854 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-79fedabe-3831-4c51-9231-4d72bb408b48 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047596 Aug 04 02:40:33.696834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 250/476] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 4 02:40:33 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:40:34.708696 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fbf6335b-ce6a-4e11-acd1-d1c1de92edb2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:34.711257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fbf6335b-ce6a-4e11-acd1-d1c1de92edb2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:34.717556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbf6335b-ce6a-4e11-acd1-d1c1de92edb2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:34.718002 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbf6335b-ce6a-4e11-acd1-d1c1de92edb2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:34.718827 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbf6335b-ce6a-4e11-acd1-d1c1de92edb2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:34.719360 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbf6335b-ce6a-4e11-acd1-d1c1de92edb2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:34.748522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fbf6335b-ce6a-4e11-acd1-d1c1de92edb2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045604 Aug 04 02:40:34.749087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 227/477] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 4 02:40:34 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:34.812912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:34.813406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:34.820416 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:34.823817 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:34.823817 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:34.823817 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:34.848322 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:40:35.116930 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6af510bb-507f-4dd6-a50b-2aa2d4ffeec9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 204 len: 0 microversion: 2.20 time: 0.307566 Aug 04 02:40:35.117564 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 251/478] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 4 02:40:34 2022] DELETE /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 02:40:35.125983 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:35.126629 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:35.133490 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:35.133936 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:35.134707 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:35.135135 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:35.272657 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:35.280999 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:35.282526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:35.284334 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f1b5b0cf-39b3-44d4-a3bf-d384ac441bbe tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.162430 Aug 04 02:40:35.285108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 228/479] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:35 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:36.309821 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:36.310428 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:36.317184 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:36.317622 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:36.318383 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:36.318844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:36.765901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:36.775218 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:36.776834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:36.778077 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5ac94487-5831-46dd-be32-bb28f66a6476 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.473306 Aug 04 02:40:36.778936 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 252/480] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:36 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:37.801558 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:37.802704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:37.810271 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:37.811683 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:37.812635 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:37.813411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:37.986935 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:37.998263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:38.000235 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:38.001660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c614a6f7-d1c2-469c-9378-4b824f13fb7a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1724 microversion: 2.20 time: 0.204238 Aug 04 02:40:38.003007 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 229/481] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:37 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:38.134156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:38.134738 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:38.141271 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:38.141753 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:38.142534 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:38.142969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:38.273046 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lazy-loading 'services' on Instance uuid bab20e5a-df8f-4361-b521-1f38b500844d {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:40:38.452309 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:38.511110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0486b118-c356-4bfc-8a15-8785c44c74fa tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments/b58dddee-6262-4cf2-9c71-b9807eb315dc" status: 202 len: 0 microversion: 2.1 time: 0.381327 Aug 04 02:40:38.515891 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 253/482] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:40:38 2022] DELETE /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments/b58dddee-6262-4cf2-9c71-b9807eb315dc => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:40:38.521476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-35597cd7-24a7-4914-bc87-28aaee43afc7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:38.524548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-35597cd7-24a7-4914-bc87-28aaee43afc7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:38.533358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35597cd7-24a7-4914-bc87-28aaee43afc7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:38.534055 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35597cd7-24a7-4914-bc87-28aaee43afc7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:38.538245 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35597cd7-24a7-4914-bc87-28aaee43afc7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:38.538245 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35597cd7-24a7-4914-bc87-28aaee43afc7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:38.572302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-35597cd7-24a7-4914-bc87-28aaee43afc7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055845 Aug 04 02:40:38.573575 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 230/483] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:40:38 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:38.599308 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-a0755e22-344d-4a57-bfad-0c46df8bd899 req-fafc6f9d-b7fe-4761-80a2-7f99b0f2fee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fb61ca-19be-4d4c-a340-ec997691ac10", "name": "network-vif-deleted", "tag": "47529bd5-9d31-4f9f-8fd1-96a64c939a51"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:38.611815 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a0755e22-344d-4a57-bfad-0c46df8bd899 req-fafc6f9d-b7fe-4761-80a2-7f99b0f2fee2 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:38.612296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a0755e22-344d-4a57-bfad-0c46df8bd899 req-fafc6f9d-b7fe-4761-80a2-7f99b0f2fee2 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:38.643344 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-a0755e22-344d-4a57-bfad-0c46df8bd899 req-fafc6f9d-b7fe-4761-80a2-7f99b0f2fee2 service nova] Creating event network-vif-deleted:47529bd5-9d31-4f9f-8fd1-96a64c939a51 for instance 88fb61ca-19be-4d4c-a340-ec997691ac10 on hv-cinder-74014 Aug 04 02:40:38.651846 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-a0755e22-344d-4a57-bfad-0c46df8bd899 req-fafc6f9d-b7fe-4761-80a2-7f99b0f2fee2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057834 Aug 04 02:40:38.652776 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 254/484] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:39.025921 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:39.027135 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:39.042891 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:39.046248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:39.047325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:39.053392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:39.158362 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:39.171041 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:39.174162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:39.176154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ce166290-a5d7-4541-8e32-1c49a926549e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 200 len: 1367 microversion: 2.20 time: 0.154657 Aug 04 02:40:39.178943 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 231/485] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:39 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:39.588734 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b7c8fb6d-5d58-4b09-8fdf-cf0071f92a05 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:39.602238 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b7c8fb6d-5d58-4b09-8fdf-cf0071f92a05 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:39.608797 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b7c8fb6d-5d58-4b09-8fdf-cf0071f92a05 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:39.609251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b7c8fb6d-5d58-4b09-8fdf-cf0071f92a05 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:39.615508 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b7c8fb6d-5d58-4b09-8fdf-cf0071f92a05 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:39.615968 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b7c8fb6d-5d58-4b09-8fdf-cf0071f92a05 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:39.688726 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b7c8fb6d-5d58-4b09-8fdf-cf0071f92a05 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107261 Aug 04 02:40:39.689327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 255/486] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:40:39 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:40:40.034894 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:40.035525 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:40.047615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:40.052163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:40.054863 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:40.055411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:40.111842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:40:40.116195 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:40.202508 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:40.203516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:40.210202 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:40.210761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:40.211714 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:40.212140 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:40.226552 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] HTTP exception thrown: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Request method failure captured: Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 HTTP/1.1 Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zDAWEdhYHez8LxaGO7monQkTpsUVQNM5FRaeoM69rLEFtF4mSaiD2Dgnpki1ebYdtiFb0vizWpWHiThkEjvmByW1H9KCROSTflqJcjhbGw-uJY7xMI6x9_6cVvjOWab9rfRN8ptyQwDacC8d0YBgu2lYcTBUY102Zo12cRVv36RAtQ Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:40:40.228272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 64be537a50754c838554d1a2e0a4177a Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:40:40.230017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '88fb61ca-19be-4d4c-a340-ec997691ac10'} Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:40:40.230872 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:40:40.232212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:40:40.233364 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Returning 404 to user: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:40:40.233364 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9ffc446a-caac-43f9-b7c7-fb1c4033c3a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 404 len: 111 microversion: 2.20 time: 0.031189 Aug 04 02:40:40.233364 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 256/487] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:40 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:40:40.238560 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e2656dc8-3cdc-43c7-9bca-199af9d8d977 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '.version_select at 0x7fa646302b80>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:40.323381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e2656dc8-3cdc-43c7-9bca-199af9d8d977 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797510353" status: 204 len: 0 microversion: 2.20 time: 0.088417 Aug 04 02:40:40.327431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 257/488] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 4 02:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797510353 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 02:40:40.370069 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:40.483238 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c24c0740-dd45-44a1-92ec-c0ad6a665984 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 204 len: 0 microversion: 2.1 time: 0.453034 Aug 04 02:40:40.488556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 232/489] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:40:40 2022] DELETE /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:40:40.496982 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:40.497823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:40.507885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:40.508719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:40.510465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:40.511196 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:40.886585 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:40.901110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8f695007-d0d1-4a7d-b43b-036e563a0735 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1690 microversion: 2.1 time: 0.410663 Aug 04 02:40:40.901691 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 258/490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:40 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1690 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:40:41.807171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b16db455-e943-4a7d-86bc-ba828e0d8c4b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'create', calling method: .version_select at 0x7fa647284d30>, body: {"keypair": {"name": "tempest-keypair-1131971570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF533xW/YPFLYybpSowhP6KXHeZ49z1IsFjdaUtQRGmh7kPLH/wt9bJYfSKyJgHVNQ9uJL4o+zV3j4b6HYCP0pHWPlEWE8tD0td7eB8JHrohPUM2tvdCIr3CyV3WQglMbg=="}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:41.823979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-b16db455-e943-4a7d-86bc-ba828e0d8c4b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:40:41.832753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-b16db455-e943-4a7d-86bc-ba828e0d8c4b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for user 64be537a50754c838554d1a2e0a4177a and project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:40:41.923208 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:41.923836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:41.931944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:41.932400 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:41.933193 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:41.933632 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:41.969512 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b16db455-e943-4a7d-86bc-ba828e0d8c4b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.176786 Aug 04 02:40:41.970604 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 233/491] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 4 02:40:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 02:40:42.097802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:42.109647 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6f6ac220-7450-44be-96e2-72343f877907 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1690 microversion: 2.1 time: 0.190422 Aug 04 02:40:42.112146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 259/492] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:41 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:43.135134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:43.135749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:43.150220 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:43.150220 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:43.151614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:43.155193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:43.391275 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:43.393677 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-5122e3d7-67e2-47ce-81e8-1af9ef86174f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1690 microversion: 2.1 time: 0.264732 Aug 04 02:40:43.394265 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 234/493] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:43 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1690 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:40:44.417735 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:44.419527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:44.426089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:44.428809 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:44.429761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:44.430759 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:44.431396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:44.446822 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1238279386", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a6827f1-0849-4a3c-806a-434939b80eec"}], "security_groups": [{"name": "tempest-securitygroup--1866976188"}], "key_name": "tempest-keypair-1131971570", "user_data": "}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:44.592702 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] validate_networks() for [('2a6827f1-0849-4a3c-806a-434939b80eec', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:40:45.067726 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:40:45.068231 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:40:45.070997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:40:45.070997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:40:45.070997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:40:45.079579 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:45.080353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:45.081956 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:45.082798 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:45.114567 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:45.123986 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-126302c5-ffba-4daf-96ae-17efb2825da7 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1690 microversion: 2.1 time: 0.711286 Aug 04 02:40:45.128483 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 260/494] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:44 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1690 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:45.132861 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:40:45.137686 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Getting quotas for user 64be537a50754c838554d1a2e0a4177a and project 16c45c4b6ccc40e3bdf304d9141d56ca. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:40:45.151359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:40:45.154126 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:40:45.296963 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b1d9178a-1423-4992-8198-ecd73076d4a3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.855462 Aug 04 02:40:45.297626 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 235/495] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 4 02:40:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 02:40:45.309364 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4900b023-a83d-47e7-a91b-b0524d011f83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:45.310232 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4900b023-a83d-47e7-a91b-b0524d011f83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:45.495701 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4900b023-a83d-47e7-a91b-b0524d011f83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:45.506401 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4900b023-a83d-47e7-a91b-b0524d011f83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:45.515978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4900b023-a83d-47e7-a91b-b0524d011f83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:45.524628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4900b023-a83d-47e7-a91b-b0524d011f83 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1282 microversion: 2.20 time: 0.211805 Aug 04 02:40:45.524628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 261/496] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:45 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:46.150304 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:46.151551 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:46.158441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:46.159164 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:46.161355 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:46.161991 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:46.241610 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:46.250195 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1815c86c-86dc-4051-aeb3-536db61c3aa8 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1623 microversion: 2.1 time: 0.103953 Aug 04 02:40:46.251310 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 236/497] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:46 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1623 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:46.549184 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:46.549792 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:46.569024 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:46.569474 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:46.570372 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:46.570890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:46.601791 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-8ca87daa-ec09-47d8-87f7-33140f6899d9 req-f7c51b2a-7b91-4f04-ac6d-4a83b74fc2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab20e5a-df8f-4361-b521-1f38b500844d", "name": "network-vif-deleted", "tag": "43e8622c-a7b9-4fda-95ee-56ab8dbaf238"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:46.614815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8ca87daa-ec09-47d8-87f7-33140f6899d9 req-f7c51b2a-7b91-4f04-ac6d-4a83b74fc2b8 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:46.615537 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8ca87daa-ec09-47d8-87f7-33140f6899d9 req-f7c51b2a-7b91-4f04-ac6d-4a83b74fc2b8 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:46.629774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-8ca87daa-ec09-47d8-87f7-33140f6899d9 req-f7c51b2a-7b91-4f04-ac6d-4a83b74fc2b8 service nova] Creating event network-vif-deleted:43e8622c-a7b9-4fda-95ee-56ab8dbaf238 for instance bab20e5a-df8f-4361-b521-1f38b500844d on hv-cinder-74014 Aug 04 02:40:46.639788 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-8ca87daa-ec09-47d8-87f7-33140f6899d9 req-f7c51b2a-7b91-4f04-ac6d-4a83b74fc2b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044535 Aug 04 02:40:46.641009 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 237/498] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:46.696525 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:46.707584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:46.709533 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:46.710704 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4dbaea12-e852-4bd9-9e8f-5cd2ff997d39 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1286 microversion: 2.20 time: 0.165411 Aug 04 02:40:46.711743 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 262/499] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:46 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:47.273624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:47.274318 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:47.281105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:47.281563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:47.282394 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:47.282874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:47.322557 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:47.323010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:47.323475 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lazy-loading 'fault' on Instance uuid bab20e5a-df8f-4361-b521-1f38b500844d {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:40:47.421341 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:47.434352 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d9b852c0-054d-41ef-9ac1-a1ccce4b90ef tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 200 len: 1335 microversion: 2.1 time: 0.163538 Aug 04 02:40:47.434352 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 238/500] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:47 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:47.736737 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:47.738205 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:47.745431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:47.746398 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:47.747498 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:47.748430 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:47.861816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:47.871653 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:47.877581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:47.883433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5058c6ca-b5d9-4d80-805e-6c14eed919de tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1334 microversion: 2.20 time: 0.151213 Aug 04 02:40:47.884281 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 263/501] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:47 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1334 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:40:48.453508 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:48.454140 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bab20e5a-df8f-4361-b521-1f38b500844d] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:48.461411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:48.461858 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:48.462701 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:48.463141 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:48.477722 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] HTTP exception thrown: Instance bab20e5a-df8f-4361-b521-1f38b500844d could not be found. Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Request method failure captured: Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d HTTP/1.1 Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDAI5xZasBc4s9WNuv-Qjf7mITTZ5lofTJ84BXtJolx_So_G1w3wwpOMpl3Ud6-qvV-S0_XwYZPQQkDLIuw3gL_ck-uTgi-lNyYs9qCsxkLmyFSwSjjnLuIMcxj6MZ_bexxe72bIS1t_rK_UW24TwWGL1CWugMmQZ3f2Dqaf-0OGJ8 Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:40:48.479426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_651f296b94d342488b3cd98998a08e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/651f296b94d342488b3cd98998a08e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 2e47969dca184aec92e620fcd53d6a5c Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance bab20e5a-df8f-4361-b521-1f38b500844d could not be found. Aug 04 02:40:48.480924 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'bab20e5a-df8f-4361-b521-1f38b500844d'} Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab20e5a-df8f-4361-b521-1f38b500844d could not be found. Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:40:48.481641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab20e5a-df8f-4361-b521-1f38b500844d could not be found. Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab20e5a-df8f-4361-b521-1f38b500844d could not be found. Aug 04 02:40:48.482877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:48.490279 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Returning 404 to user: Instance bab20e5a-df8f-4361-b521-1f38b500844d could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:40:48.490279 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d52f53f3-1e97-464e-8c06-364d284646b6 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d" status: 404 len: 111 microversion: 2.1 time: 0.031413 Aug 04 02:40:48.490279 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 239/502] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:48 2022] GET /compute/v2.1/servers/bab20e5a-df8f-4361-b521-1f38b500844d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:48.490959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-cb559e93-7cae-4560-999e-773fcbbd12cd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '.version_select at 0x7fa6461ff550>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:48.569999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-cb559e93-7cae-4560-999e-773fcbbd12cd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430516772" status: 202 len: 0 microversion: 2.1 time: 0.083974 Aug 04 02:40:48.570914 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 264/503] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 4 02:40:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430516772 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:40:48.914976 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:48.915585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:48.921738 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:48.922181 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:48.923236 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:48.923735 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:48.995601 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:49.006634 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:49.008563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:49.009696 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3e514d7d-973e-4f61-87d1-34ffab10709c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1340 microversion: 2.20 time: 0.099199 Aug 04 02:40:49.010249 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 240/504] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:48 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:50.034473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:50.035272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:50.043809 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:50.043809 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:50.165619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:50.165619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:50.357447 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:50.368834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:50.370746 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:50.372112 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c75295a9-92ba-42a4-9ac7-c0295a2bb477 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.343233 Aug 04 02:40:50.382827 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 265/505] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:50 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:40:50.635506 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-09b6ee94-e446-4495-bc89-eb13b0de63cf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:50.640587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-09b6ee94-e446-4495-bc89-eb13b0de63cf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:50.644535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-09b6ee94-e446-4495-bc89-eb13b0de63cf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:50.645060 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-09b6ee94-e446-4495-bc89-eb13b0de63cf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:50.645926 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-09b6ee94-e446-4495-bc89-eb13b0de63cf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:50.646396 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-09b6ee94-e446-4495-bc89-eb13b0de63cf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:50.679063 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-09b6ee94-e446-4495-bc89-eb13b0de63cf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047488 Aug 04 02:40:50.689925 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 241/506] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:40:50 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:40:50.747804 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:50.748306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:50.755118 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:50.761365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:50.761365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:50.761365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:50.783234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:40:51.060952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b13b486e-7682-46c5-94ce-b8865413bfdf tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 204 len: 0 microversion: 2.1 time: 0.311568 Aug 04 02:40:51.060952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 266/507] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:40:50 2022] DELETE /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:40:51.066272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:51.066996 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:51.073973 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:51.074352 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:51.075181 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:51.075622 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:51.225717 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:51.233270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4b8fbfe8-07d0-4ad2-b99a-73a2ef2f66d9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1673 microversion: 2.1 time: 0.171227 Aug 04 02:40:51.233835 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 242/508] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:51 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:51.339368 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-1ecb9c67-5455-446e-9c58-2af9c609faa2 req-e32ddb10-9996-433d-ad0f-2cd62ae89d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa07bb4-3207-4fba-bb58-46ba0452ca16", "tag": "9e4ea6f4-5972-44dc-a2ca-c3771cc56a76"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:51.354944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-1ecb9c67-5455-446e-9c58-2af9c609faa2 req-e32ddb10-9996-433d-ad0f-2cd62ae89d5f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:51.355731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-1ecb9c67-5455-446e-9c58-2af9c609faa2 req-e32ddb10-9996-433d-ad0f-2cd62ae89d5f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:51.369292 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-1ecb9c67-5455-446e-9c58-2af9c609faa2 req-e32ddb10-9996-433d-ad0f-2cd62ae89d5f service nova] Creating event network-changed:9e4ea6f4-5972-44dc-a2ca-c3771cc56a76 for instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 on hv-cinder-74014 Aug 04 02:40:51.374725 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-1ecb9c67-5455-446e-9c58-2af9c609faa2 req-e32ddb10-9996-433d-ad0f-2cd62ae89d5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043808 Aug 04 02:40:51.375649 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 267/509] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:51.402024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:51.402024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:51.405941 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:51.406398 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:51.407216 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:51.407647 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:51.569794 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:51.579372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:51.580956 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:51.582159 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a783b173-abc6-494e-8979-97e9e481e7d2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.189830 Aug 04 02:40:51.597850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 243/510] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:51 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:52.257299 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:52.258000 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:52.281494 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:52.281932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:52.282921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:52.283507 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:52.488395 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:52.496905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f3f1ed98-0046-49d1-b8c4-8ba2ea4a17c9 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1673 microversion: 2.1 time: 0.244859 Aug 04 02:40:52.498732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 268/511] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:52 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1673 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:52.608204 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:52.608823 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:52.624632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:52.624632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:52.624632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:52.624632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:52.782302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:52.782826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:52.791956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:52.792411 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:52.793824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:52.793824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:52.804639 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:52.814798 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:52.816420 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:52.818371 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f33d87dd-16a1-43ac-afc1-943473e8e909 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.216779 Aug 04 02:40:52.828983 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:40:52.834184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 244/512] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:52 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:53.099952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-60bd4923-c4d5-4dff-8364-ee0e79b45c44 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 204 len: 0 microversion: 2.1 time: 0.321420 Aug 04 02:40:53.101094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 269/513] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:40:52 2022] DELETE /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:40:53.109836 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:53.110461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:53.117908 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:53.118656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:53.119607 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:53.120047 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:53.321731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:53.329842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4d3e12d2-86a3-442a-a115-8804ecf4397c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1508 microversion: 2.1 time: 0.224400 Aug 04 02:40:53.330827 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 245/514] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:53 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:53.520495 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:53.521221 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:53.538336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:53.539192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:53.540110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:53.540615 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:53.706993 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:53.716434 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-89878540-26c9-41db-bbf6-9b62c420ac18 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1673 microversion: 2.1 time: 0.200329 Aug 04 02:40:53.717556 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 270/515] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:53 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:53.841688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:53.843320 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:53.851453 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:53.851906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:53.852689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:53.853134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:54.069418 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:54.078236 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:54.079780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:54.080913 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0f12291c-0907-4616-91ce-0db762578cfc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.243566 Aug 04 02:40:54.081549 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 246/516] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:53 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:54.356141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:54.357024 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:54.369736 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:54.370345 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:54.371158 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:54.371761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:54.520390 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:54.528525 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d0ee925a-5849-4f52-93e8-95167bc749ac tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1508 microversion: 2.1 time: 0.178366 Aug 04 02:40:54.530435 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 271/517] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:54 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:54.737442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:54.737967 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:54.744753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:54.745195 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:54.745953 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:54.746388 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:54.885010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:54.893147 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-20e66785-abc7-4a2c-9b1a-d1b1e19457c7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1673 microversion: 2.1 time: 0.159684 Aug 04 02:40:54.893735 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 247/518] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:54 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:55.105686 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:55.106296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:55.112544 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:55.112995 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:55.114216 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:55.114555 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:55.119254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:55.281605 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:55.291342 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:55.293587 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:55.294755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-db05c898-f129-4919-bacd-efa3079c60ec tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.193110 Aug 04 02:40:55.295324 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 272/519] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:55 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:55.552759 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:55.553390 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:55.555424 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:55.556580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=10 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:55.563156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:55.563879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:55.564723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:55.565325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:55.924574 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:55.925193 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:55.937873 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:55.953719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:55.954583 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:55.957469 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:55.958135 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:56.307649 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:56.334690 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-022ee234-40dd-4538-bc23-83904ec4f09c tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1508 microversion: 2.1 time: 0.787131 Aug 04 02:40:56.336398 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 248/520] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:55 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1508 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:56.351169 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:56.353188 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:56.364262 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:56.364974 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:56.369582 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:56.376809 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:56.469950 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:56.480082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2900033c-1937-4320-a68f-f6e3e1a01e97 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1673 microversion: 2.1 time: 0.564161 Aug 04 02:40:56.480672 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 273/521] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:55 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1673 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:40:56.737130 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:56.748982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:56.752644 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:56.759735 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8e85c6b4-0694-4bb5-a07c-1f3b190b7935 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.419784 Aug 04 02:40:56.760247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 249/522] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:56 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:56.884579 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-4f394faa-8780-4473-9774-c86ce4f4503a req-ef0e6236-60b1-4339-a245-147796f09fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc200eb6-cfc2-4316-abb2-207a36281bf7", "name": "network-vif-unplugged", "status": "completed", "tag": "d252568c-1f06-4cbc-bf58-fc9263892021"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:56.900773 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-4f394faa-8780-4473-9774-c86ce4f4503a req-ef0e6236-60b1-4339-a245-147796f09fba service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:56.901495 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-4f394faa-8780-4473-9774-c86ce4f4503a req-ef0e6236-60b1-4339-a245-147796f09fba service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:56.917906 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-4f394faa-8780-4473-9774-c86ce4f4503a req-ef0e6236-60b1-4339-a245-147796f09fba service nova] Creating event network-vif-unplugged:d252568c-1f06-4cbc-bf58-fc9263892021 for instance bc200eb6-cfc2-4316-abb2-207a36281bf7 on hv-cinder-74014 Aug 04 02:40:56.923168 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-4f394faa-8780-4473-9774-c86ce4f4503a req-ef0e6236-60b1-4339-a245-147796f09fba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043649 Aug 04 02:40:56.924453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 274/523] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:57.301873 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-f56166d7-6e3f-4a9d-af09-582076d4596a req-81a5f140-1874-4264-8569-c677c9ca11bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc200eb6-cfc2-4316-abb2-207a36281bf7", "name": "network-vif-deleted", "tag": "d252568c-1f06-4cbc-bf58-fc9263892021"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:57.328070 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-f56166d7-6e3f-4a9d-af09-582076d4596a req-81a5f140-1874-4264-8569-c677c9ca11bb service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:57.328628 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-f56166d7-6e3f-4a9d-af09-582076d4596a req-81a5f140-1874-4264-8569-c677c9ca11bb service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:57.349169 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-f56166d7-6e3f-4a9d-af09-582076d4596a req-81a5f140-1874-4264-8569-c677c9ca11bb service nova] Creating event network-vif-deleted:d252568c-1f06-4cbc-bf58-fc9263892021 for instance bc200eb6-cfc2-4316-abb2-207a36281bf7 on hv-cinder-74014 Aug 04 02:40:57.362898 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-f56166d7-6e3f-4a9d-af09-582076d4596a req-81a5f140-1874-4264-8569-c677c9ca11bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058942 Aug 04 02:40:57.362898 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 250/524] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:57.363212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:57.363212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:57.384315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:57.384779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:57.385576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:57.386017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:57.506282 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:57.508199 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:57.509086 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:57.519481 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2cf783d7-76c1-47a5-b8ca-3eba13825a33 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1466 microversion: 2.1 time: 0.167101 Aug 04 02:40:57.521277 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 275/525] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:57 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:40:57.530753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:57.532285 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:57.533100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:57.533543 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:57.542125 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:57.783750 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:57.789883 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:57.790527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:57.807382 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:57.807929 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:57.809242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b2a1ffa9-54cf-4455-8ee4-06f34cd40c7c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1606 microversion: 2.1 time: 0.301309 Aug 04 02:40:57.810278 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 251/526] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:57 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1606 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:40:57.828093 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:57.832402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:58.071958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:58.081780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:58.083788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:58.085319 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-276bea7a-8515-48ac-979d-5c5f5f2c77d9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.305356 Aug 04 02:40:58.086076 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 276/527] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:57 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:58.541874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:58.542477 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:58.550158 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:58.550920 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:58.552897 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:58.553714 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:58.622550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:58.623247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:58.623850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lazy-loading 'fault' on Instance uuid bc200eb6-cfc2-4316-abb2-207a36281bf7 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:40:58.674891 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:58.686314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-dd8ee8a9-cfa7-4482-a764-877da4d53bb2 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 200 len: 1312 microversion: 2.1 time: 0.148110 Aug 04 02:40:58.699926 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 252/528] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:58 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:58.831025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:58.832973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:58.848772 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:58.851160 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:58.851997 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:58.853113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:58.901838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:58.902356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:58.903277 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lazy-loading 'fault' on Instance uuid ab1c4809-6fd6-4207-b2e0-7b9801de9c0f {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:40:58.989617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:58.999120 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a9e72009-0ba7-4e28-b9d7-3e840a32b905 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 200 len: 1328 microversion: 2.1 time: 0.172183 Aug 04 02:40:58.999693 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 277/529] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:58 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 1328 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:40:59.115654 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:59.118981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:59.125372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:59.126073 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:59.127058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:59.127677 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:59.301043 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:59.309682 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:59.311229 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:40:59.312385 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ebdc58ea-5d48-4dc6-9325-877e629470b9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.201936 Aug 04 02:40:59.312943 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 253/530] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:40:59 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:40:59.428700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-095b0831-0f83-4fa7-97c0-eb74de85d4a1 req-ac955227-93af-4b31-9a34-9296054ba5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1c4809-6fd6-4207-b2e0-7b9801de9c0f", "name": "network-vif-deleted", "tag": "0e8ed6f1-6392-4077-a6da-de33241cc091"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:40:59.439805 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-095b0831-0f83-4fa7-97c0-eb74de85d4a1 req-ac955227-93af-4b31-9a34-9296054ba5f6 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:59.440469 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-095b0831-0f83-4fa7-97c0-eb74de85d4a1 req-ac955227-93af-4b31-9a34-9296054ba5f6 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:59.452111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-095b0831-0f83-4fa7-97c0-eb74de85d4a1 req-ac955227-93af-4b31-9a34-9296054ba5f6 service nova] Creating event network-vif-deleted:0e8ed6f1-6392-4077-a6da-de33241cc091 for instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f on hv-cinder-74014 Aug 04 02:40:59.457423 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-095b0831-0f83-4fa7-97c0-eb74de85d4a1 req-ac955227-93af-4b31-9a34-9296054ba5f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Aug 04 02:40:59.458195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 278/531] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:40:59.710114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:59.710772 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: bc200eb6-cfc2-4316-abb2-207a36281bf7] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:59.717895 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:59.718347 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:59.719433 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:59.719881 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:59.736405 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] HTTP exception thrown: Instance bc200eb6-cfc2-4316-abb2-207a36281bf7 could not be found. Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Request method failure captured: Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 HTTP/1.1 Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDAI5xZasBc4s9WNuv-Qjf7mITTZ5lofTJ84BXtJolx_So_G1w3wwpOMpl3Ud6-qvV-S0_XwYZPQQkDLIuw3gL_ck-uTgi-lNyYs9qCsxkLmyFSwSjjnLuIMcxj6MZ_bexxe72bIS1t_rK_UW24TwWGL1CWugMmQZ3f2Dqaf-0OGJ8 Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:40:59.738353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_651f296b94d342488b3cd98998a08e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/651f296b94d342488b3cd98998a08e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 2e47969dca184aec92e620fcd53d6a5c Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance bc200eb6-cfc2-4316-abb2-207a36281bf7 could not be found. Aug 04 02:40:59.742167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'bc200eb6-cfc2-4316-abb2-207a36281bf7'} Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc200eb6-cfc2-4316-abb2-207a36281bf7 could not be found. Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:40:59.743168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc200eb6-cfc2-4316-abb2-207a36281bf7 could not be found. Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc200eb6-cfc2-4316-abb2-207a36281bf7 could not be found. Aug 04 02:40:59.744670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:40:59.746753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Returning 404 to user: Instance bc200eb6-cfc2-4316-abb2-207a36281bf7 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:40:59.750096 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7da89300-c1a7-4d0f-abef-4559e83cc676 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7" status: 404 len: 111 microversion: 2.1 time: 0.042689 Aug 04 02:40:59.750096 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 254/532] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:40:59 2022] GET /compute/v2.1/servers/bc200eb6-cfc2-4316-abb2-207a36281bf7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:59.758628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:40:59.759224 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:40:59.765744 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:59.766199 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:59.767012 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:40:59.767453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:40:59.795989 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:41:00.021888 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:00.022846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:00.036148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:00.037023 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:00.037991 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:00.050639 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:00.065995 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] HTTP exception thrown: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Request method failure captured: Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f HTTP/1.1 Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zC-choGaHQNSVeP5lvsf-TMOx0pgTZfwugizbiDis9YLvS9LWr2lUdXa7QUSGMMMxhvZl1pZEWmAhpMGm_RIvJPnVn6MQIEUwwK7Vqb2hbbXCEgsK7MbTAWodgAtJX6RDskVMF9e8ki37eKoe0TWgjp05L8fvM5hb7PGYboF8-RQNo Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:41:00.068614 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 99068d55e19e4b3cbf9197ca46d86fd3 Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:41:00.080539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'ab1c4809-6fd6-4207-b2e0-7b9801de9c0f'} Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:41:00.081489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:41:00.083982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:00.085280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Returning 404 to user: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:41:00.085280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-177b91f0-79cd-416a-b044-7adb78d0b602 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 404 len: 111 microversion: 2.1 time: 0.053374 Aug 04 02:41:00.085280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 255/533] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:00 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:41:00.085280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e9150883-d0ce-4c67-8da6-4d4aa2fbda4d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '.version_select at 0x7fa6472600d0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:00.122365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-91116dea-6450-43fd-a895-27ea627a8403 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 204 len: 0 microversion: 2.1 time: 0.369263 Aug 04 02:41:00.126695 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 279/534] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:40:59 2022] DELETE /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:41:00.132630 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:00.133688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:00.140526 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:00.140976 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:00.141745 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:00.142182 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:00.152440 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e9150883-d0ce-4c67-8da6-4d4aa2fbda4d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865226023" status: 202 len: 0 microversion: 2.1 time: 0.076974 Aug 04 02:41:00.155786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 256/535] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 4 02:41:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865226023 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:41:00.335948 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:00.336814 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:00.348496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:00.349293 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:00.350241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:00.350704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:00.390283 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:00.399485 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-18604eaa-facd-475d-9c5d-e0b2679e7e31 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.271548 Aug 04 02:41:00.403173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 280/536] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:00 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:00.554814 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:00.570105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:00.573067 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:00.576664 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f2e5fc75-fcd5-4da2-b525-e5ef77f9edda tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.245781 Aug 04 02:41:00.593123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 257/537] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:00 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:00.986534 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-ab87d52d-f24e-4adb-975b-7ce546216016 req-beb9f59d-cc81-45be-81c7-b14cbf23264e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa07bb4-3207-4fba-bb58-46ba0452ca16", "name": "network-vif-plugged", "status": "completed", "tag": "9e4ea6f4-5972-44dc-a2ca-c3771cc56a76"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:01.002878 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-ab87d52d-f24e-4adb-975b-7ce546216016 req-beb9f59d-cc81-45be-81c7-b14cbf23264e service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:01.003560 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-ab87d52d-f24e-4adb-975b-7ce546216016 req-beb9f59d-cc81-45be-81c7-b14cbf23264e service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:01.016519 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-ab87d52d-f24e-4adb-975b-7ce546216016 req-beb9f59d-cc81-45be-81c7-b14cbf23264e service nova] Creating event network-vif-plugged:9e4ea6f4-5972-44dc-a2ca-c3771cc56a76 for instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 on hv-cinder-74014 Aug 04 02:41:01.021971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-ab87d52d-f24e-4adb-975b-7ce546216016 req-beb9f59d-cc81-45be-81c7-b14cbf23264e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039398 Aug 04 02:41:01.022964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 281/538] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:01.200773 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9bcafa82-d742-4834-9497-3bb783cbd124 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'create', calling method: .version_select at 0x7fa647274040>, body: {"keypair": {"name": "tempest-keypair-1658122665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoDuagj8lCAVbVbYIlIiYZujFfk27vuJ5UvC5t2QkIPGRGPYYHvZokz16zaxHf9VbvJNAY5LqJ9CAOefBpSSZ1tJ4yQyPj0vtLss3PdhHjZyuJ9EDrbqVy3GQwxVc99kg=="}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:01.218836 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-9bcafa82-d742-4834-9497-3bb783cbd124 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:41:01.223012 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-9bcafa82-d742-4834-9497-3bb783cbd124 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for user 99068d55e19e4b3cbf9197ca46d86fd3 and project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:41:01.283408 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9bcafa82-d742-4834-9497-3bb783cbd124 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087174 Aug 04 02:41:01.284318 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 258/539] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:41:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:01.426031 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:01.426975 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:01.445880 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:01.454358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:01.454358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:01.454358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:01.602333 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:01.603335 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:01.609978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:01.611728 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:01.612415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:01.613399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:01.614933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:01.668190 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:01.677505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7d74bbc3-9a77-4b10-bcd5-2eb9d1d500bd tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.255659 Aug 04 02:41:01.678767 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 282/540] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:01 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:01.798045 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:01.807657 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:01.809190 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:01.812823 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-da448579-ea2d-4ac6-90d5-cf7439e4a717 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.213346 Aug 04 02:41:01.812823 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 259/541] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:01 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:41:02.698906 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:02.699570 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:02.706552 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:02.713601 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:02.713601 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:02.713601 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:02.833079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:02.833897 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:02.841449 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:02.841901 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:02.842712 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:02.843214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:02.852712 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:02.866216 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-be2b42d5-9f74-4fa5-b852-305c08bf7413 tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.170766 Aug 04 02:41:02.866844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 283/542] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:02 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:03.007852 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:03.016727 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:03.018454 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:03.020548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-57f3e9ae-da3c-4b27-80fd-ab7639ffa761 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.191440 Aug 04 02:41:03.021363 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 260/543] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:02 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:41:03.715542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2f69400c-2910-4fa9-9ff7-5a322c13db1a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Action: 'create', calling method: .version_select at 0x7fa64620e3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1617273470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5juZwv1/EnDxlivah3NVIO/x5riusewprnpkZdO5Pg9b73T67ev/GjjevLWLqJvKTMlw9ffwcJAGJPffPss6Vg/Ym3kQMRVonn53OJ/uSZfnioHkS4gUx9OR38hFjrgg=="}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:03.732680 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-2f69400c-2910-4fa9-9ff7-5a322c13db1a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Getting quotas for project b14b11a92ccb494ea480962861bac477. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:41:03.736582 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-2f69400c-2910-4fa9-9ff7-5a322c13db1a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Getting quotas for user 8a7246f0c1f44d968ca839d36ecae75e and project b14b11a92ccb494ea480962861bac477. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:41:03.820572 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2f69400c-2910-4fa9-9ff7-5a322c13db1a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.108970 Aug 04 02:41:03.821177 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 284/544] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:41:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:03.876917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2058503178", "imageRef": "6c22873d-b900-4263-bf63-e752f6548e3f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1617273470", "networks": [{"uuid": "8ea68001-ff98-4218-8f62-2a4dd0501e50"}]}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:03.885829 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:03.886905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:03.893534 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:03.894068 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:03.894961 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:03.895404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:03.935707 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] validate_networks() for [('8ea68001-ff98-4218-8f62-2a4dd0501e50', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:41:04.041308 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:04.047727 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c64ca504-808f-4146-9c7b-32939ab5d0da tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1521 microversion: 2.1 time: 0.165876 Aug 04 02:41:04.050899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 285/545] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:03 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:04.056279 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:04.056952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:04.065717 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:04.066246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:04.067080 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:04.067518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:04.204829 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:04.213973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:04.215663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:04.216820 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d9ef6244-6472-4a1b-872c-dcebff397a74 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.164713 Aug 04 02:41:04.217418 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 286/546] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:04 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:04.841991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-e8d828da-f26a-4f25-89b2-4e76b9754763 req-3cfa10d9-1655-44a5-83f3-40495fcbdb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21754572-a17a-4c62-9a46-d59d25ba3e8c", "name": "network-vif-deleted", "tag": "b8b834c3-d502-4593-a9eb-906f65cab6c2"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:04.856495 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e8d828da-f26a-4f25-89b2-4e76b9754763 req-3cfa10d9-1655-44a5-83f3-40495fcbdb06 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:04.857232 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e8d828da-f26a-4f25-89b2-4e76b9754763 req-3cfa10d9-1655-44a5-83f3-40495fcbdb06 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:04.870228 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-e8d828da-f26a-4f25-89b2-4e76b9754763 req-3cfa10d9-1655-44a5-83f3-40495fcbdb06 service nova] Creating event network-vif-deleted:b8b834c3-d502-4593-a9eb-906f65cab6c2 for instance 21754572-a17a-4c62-9a46-d59d25ba3e8c on hv-cinder-74014 Aug 04 02:41:04.875812 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-e8d828da-f26a-4f25-89b2-4e76b9754763 req-3cfa10d9-1655-44a5-83f3-40495fcbdb06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039636 Aug 04 02:41:04.876515 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 287/547] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:41:04.955495 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:41:04.955999 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:41:04.956389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:41:04.956799 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:41:04.957774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:41:04.968247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:04.968701 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:04.969547 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:04.969971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:04.994766 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Getting quotas for project b14b11a92ccb494ea480962861bac477. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:41:04.998849 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Getting quotas for user 8a7246f0c1f44d968ca839d36ecae75e and project b14b11a92ccb494ea480962861bac477. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:41:05.010187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:41:05.012424 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c22873d-b900-4263-bf63-e752f6548e3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:41:05.013407 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-553331889", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b22a8bf0-7345-42b7-ab28-223e4daaed3c"}], "security_groups": [{"name": "tempest-securitygroup--991515060"}], "key_name": "tempest-keypair-1658122665", "user_data": "}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:05.123662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] validate_networks() for [('b22a8bf0-7345-42b7-ab28-223e4daaed3c', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:41:05.130371 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0eb3334f-c0f3-4947-8b5a-2935c1f1d9ac tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257260 Aug 04 02:41:05.131285 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 261/548] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:41:05.136016 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:05.137194 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:05.144592 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:05.147302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:05.147302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:05.147302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:05.223491 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e47969dca184aec92e620fcd53d6a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651f296b94d342488b3cd98998a08e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:05.232410 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-60be696b-1db6-43b5-8b1e-06bdcd4452bf tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 200 len: 1479 microversion: 2.1 time: 0.099879 Aug 04 02:41:05.233099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 262/549] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:05 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 1479 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:05.239640 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-24c540da-8101-4d32-990f-91696b45bd38 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:05.240600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-24c540da-8101-4d32-990f-91696b45bd38 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:05.324294 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-24c540da-8101-4d32-990f-91696b45bd38 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:05.334926 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-24c540da-8101-4d32-990f-91696b45bd38 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1259 microversion: 2.1 time: 0.100073 Aug 04 02:41:05.335529 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 263/550] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:05 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1259 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:05.347450 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:05.347450 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:05.347840 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:05.354618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:05.354618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:05.354618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:05.528602 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:05.537644 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:05.539624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:05.541535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6fe93dfc-ca68-4c61-b6dd-d0fe74b56d67 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1408 microversion: 2.20 time: 0.204355 Aug 04 02:41:05.541872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 264/551] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:05 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:05.587073 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:41:05.588409 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:41:05.588898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:41:05.589312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:41:05.589726 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:41:05.599809 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:05.600246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:05.601113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:05.601545 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:05.620658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:41:05.625271 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Getting quotas for user 99068d55e19e4b3cbf9197ca46d86fd3 and project a2c4c2e98c444c07b2919db3e65cedf2. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:41:05.627653 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:05.637289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:41:05.639715 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:41:05.806613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d6eb3208-bd6d-4f4a-8f96-8b94623761fe tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.797911 Aug 04 02:41:05.813071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 288/552] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:41:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 02:41:05.819629 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-cc0c9747-0661-41f2-8f3c-244547b73d4d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:05.823197 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-cc0c9747-0661-41f2-8f3c-244547b73d4d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:05.879655 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cc0c9747-0661-41f2-8f3c-244547b73d4d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:05.886591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-cc0c9747-0661-41f2-8f3c-244547b73d4d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1237 microversion: 2.1 time: 0.072144 Aug 04 02:41:05.887105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 265/553] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:05 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:06.258473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:06.259126 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] [instance: 21754572-a17a-4c62-9a46-d59d25ba3e8c] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:06.266746 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.267246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.267990 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.268426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.281903 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] HTTP exception thrown: Instance 21754572-a17a-4c62-9a46-d59d25ba3e8c could not be found. Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Request method failure captured: Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c HTTP/1.1 Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zDAI5xZasBc4s9WNuv-Qjf7mITTZ5lofTJ84BXtJolx_So_G1w3wwpOMpl3Ud6-qvV-S0_XwYZPQQkDLIuw3gL_ck-uTgi-lNyYs9qCsxkLmyFSwSjjnLuIMcxj6MZ_bexxe72bIS1t_rK_UW24TwWGL1CWugMmQZ3f2Dqaf-0OGJ8 Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:41:06.283577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/651f296b94d342488b3cd98998a08e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_651f296b94d342488b3cd98998a08e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/651f296b94d342488b3cd98998a08e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 651f296b94d342488b3cd98998a08e02 Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1097401939 Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 2e47969dca184aec92e620fcd53d6a5c Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1097401939-project Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 21754572-a17a-4c62-9a46-d59d25ba3e8c could not be found. Aug 04 02:41:06.285082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '21754572-a17a-4c62-9a46-d59d25ba3e8c'} Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21754572-a17a-4c62-9a46-d59d25ba3e8c could not be found. Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:41:06.286405 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21754572-a17a-4c62-9a46-d59d25ba3e8c could not be found. Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21754572-a17a-4c62-9a46-d59d25ba3e8c could not be found. Aug 04 02:41:06.287973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:41:06.289209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] Returning 404 to user: Instance 21754572-a17a-4c62-9a46-d59d25ba3e8c could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:41:06.289209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-55d9b958-8d83-4224-a967-4062d6253c6f tempest-ServerRescueNegativeTestJSON-1097401939 tempest-ServerRescueNegativeTestJSON-1097401939-project] 10.222.0.60 "GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c" status: 404 len: 111 microversion: 2.1 time: 0.031644 Aug 04 02:41:06.289209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 289/554] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:06 2022] GET /compute/v2.1/servers/21754572-a17a-4c62-9a46-d59d25ba3e8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:41:06.361907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:06.363958 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:06.374769 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.375466 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.376357 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.377100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.454994 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:06.462978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-81f25ffa-317e-4a8d-9355-dc1a1b5aa553 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1263 microversion: 2.1 time: 0.106726 Aug 04 02:41:06.463561 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 266/555] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:06 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1263 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:06.563515 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:06.564059 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:06.570953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.571403 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.572399 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.572836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.797663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:06.806852 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:06.810952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:06.810952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-641087b4-377b-470d-9f99-84302e8695ae tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1601 microversion: 2.20 time: 0.250190 Aug 04 02:41:06.810952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 290/556] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:06 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1601 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:06.835051 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b3e6818d-cf2c-4bb7-a37c-9e8a8acb4665 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:06.835774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b3e6818d-cf2c-4bb7-a37c-9e8a8acb4665 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:06.842451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b3e6818d-cf2c-4bb7-a37c-9e8a8acb4665 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.843091 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b3e6818d-cf2c-4bb7-a37c-9e8a8acb4665 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.845364 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b3e6818d-cf2c-4bb7-a37c-9e8a8acb4665 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.845822 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b3e6818d-cf2c-4bb7-a37c-9e8a8acb4665 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.917423 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:06.918055 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:06.931232 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b3e6818d-cf2c-4bb7-a37c-9e8a8acb4665 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101650 Aug 04 02:41:06.935881 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.936018 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.936764 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:06.937207 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:06.940114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 267/557] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 4 02:41:06 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:41:07.029622 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:07.033275 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:07.048406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-77b585f5-b0b0-4790-b1a2-a29412c49a58 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1241 microversion: 2.1 time: 0.142624 Aug 04 02:41:07.061894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 291/558] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:06 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:07.487002 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:07.488441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:07.496099 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:07.501566 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:07.505392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:07.506201 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:07.664956 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:07.672260 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-102f9aa6-833b-4f00-925f-5f153aa6a1d2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1319 microversion: 2.1 time: 0.192284 Aug 04 02:41:07.673258 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 268/559] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:07 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:08.070237 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:08.070944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:08.078226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:08.078706 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:08.079475 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:08.079907 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:08.508936 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:08.516528 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3f75f22b-173a-43ab-8a0f-0a5cdd4c6265 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1289 microversion: 2.1 time: 0.451234 Aug 04 02:41:08.531285 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 292/560] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:08 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1289 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:08.703228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:08.705180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:08.730455 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:08.743154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:08.746556 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:08.749436 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:08.922321 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:08.938351 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-750f3a6a-5108-40d2-bc38-4c11137c6c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1317 microversion: 2.1 time: 0.245867 Aug 04 02:41:08.938988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 269/561] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:08 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:09.150153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-f6c21fe4-2976-4564-a2a2-b07163740d60 req-16735af1-a483-4c01-8758-2bb995c66384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa07bb4-3207-4fba-bb58-46ba0452ca16", "tag": "9e4ea6f4-5972-44dc-a2ca-c3771cc56a76"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:09.173522 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-f6c21fe4-2976-4564-a2a2-b07163740d60 req-16735af1-a483-4c01-8758-2bb995c66384 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:09.173893 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-f6c21fe4-2976-4564-a2a2-b07163740d60 req-16735af1-a483-4c01-8758-2bb995c66384 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:09.212461 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-f6c21fe4-2976-4564-a2a2-b07163740d60 req-16735af1-a483-4c01-8758-2bb995c66384 service nova] Creating event network-changed:9e4ea6f4-5972-44dc-a2ca-c3771cc56a76 for instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 on hv-cinder-74014 Aug 04 02:41:09.229594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-f6c21fe4-2976-4564-a2a2-b07163740d60 req-16735af1-a483-4c01-8758-2bb995c66384 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080549 Aug 04 02:41:09.233192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 293/562] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:09.545983 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:09.546673 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:09.577753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:09.577753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:09.577753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:09.577753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:09.963145 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:09.964188 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:09.976645 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:09.979372 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:09.982293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:09.983024 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:10.316695 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:10.331938 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-cf4e39e8-1c83-4cac-8026-ae4616c52990 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1295 microversion: 2.1 time: 0.792145 Aug 04 02:41:10.336621 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 270/563] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:09 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1295 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:10.364129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:10.377245 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4635fed5-0d98-4591-954d-8077dd751b5b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.415647 Aug 04 02:41:10.387690 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 294/564] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:09 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:11.360166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:11.360876 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:11.393321 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:11.394143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:11.395278 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:11.396033 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:11.400773 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:11.406251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:11.435322 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:11.436057 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:11.445078 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:11.447033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:11.971586 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:11.985555 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c9c79c45-2ab2-4513-93d9-4cec7389b6b4 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.629381 Aug 04 02:41:11.986263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 271/565] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:11 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:12.221848 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:12.241449 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-61558f68-bc63-420d-b64a-91a75e1739ff tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.845644 Aug 04 02:41:12.242885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 295/566] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:11 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:12.715089 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-dc8eabfa-23e7-49f3-b9f4-4e8435d59a10 req-f0588aab-bdda-4acc-926f-7e1b6ee03d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deddf119-039c-4060-a7bd-79554b9c1ba0", "tag": "c10bdcd9-3678-4c5c-92d6-0dbad937505d"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:12.753725 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-dc8eabfa-23e7-49f3-b9f4-4e8435d59a10 req-f0588aab-bdda-4acc-926f-7e1b6ee03d3f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:12.755225 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-dc8eabfa-23e7-49f3-b9f4-4e8435d59a10 req-f0588aab-bdda-4acc-926f-7e1b6ee03d3f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:12.773063 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-dc8eabfa-23e7-49f3-b9f4-4e8435d59a10 req-f0588aab-bdda-4acc-926f-7e1b6ee03d3f service nova] Creating event network-changed:c10bdcd9-3678-4c5c-92d6-0dbad937505d for instance deddf119-039c-4060-a7bd-79554b9c1ba0 on hv-cinder-74014 Aug 04 02:41:12.781832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-dc8eabfa-23e7-49f3-b9f4-4e8435d59a10 req-f0588aab-bdda-4acc-926f-7e1b6ee03d3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072908 Aug 04 02:41:12.784015 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 272/567] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:13.008576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:13.009642 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:13.016815 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:13.020265 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:13.020265 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:13.020265 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:13.235810 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:13.243991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0cc78a66-7d49-451b-ba8b-9882e0866bd3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.240159 Aug 04 02:41:13.244899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 296/568] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:13 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:13.264479 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:13.265440 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:13.274501 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:13.279103 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:13.279103 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:13.279103 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:13.521159 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:13.529711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-807736b1-10f3-4301-aa71-dedebdc48a39 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.269726 Aug 04 02:41:13.530666 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 273/569] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:13 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:14.270308 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:14.270986 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:14.277339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:14.277789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:14.278585 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:14.279323 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:14.447960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:14.456771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-cbc926f5-8b29-4fe9-bbc8-0f7a0d6de372 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.192388 Aug 04 02:41:14.458182 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 297/570] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:14 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:14.554107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:14.554107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:14.560645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:14.561101 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:14.561913 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:14.562352 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:14.583737 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=100 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:14.756091 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:14.756091 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-548bb7c7-503b-495c-9054-7b23e6005802 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.180946 Aug 04 02:41:14.756091 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 274/571] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:14 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:14.807082 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-5fb17e37-755b-4775-bb13-79236eb19ba2 req-0be8db84-6223-4e84-b9df-7a50601d3f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec4ee6a-83ae-412a-869e-6f2ef0d33553", "tag": "2633d7b8-bde0-4b89-ad15-c794d1a1ed93"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:14.822253 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-5fb17e37-755b-4775-bb13-79236eb19ba2 req-0be8db84-6223-4e84-b9df-7a50601d3f03 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:14.823465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-5fb17e37-755b-4775-bb13-79236eb19ba2 req-0be8db84-6223-4e84-b9df-7a50601d3f03 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:14.837647 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-5fb17e37-755b-4775-bb13-79236eb19ba2 req-0be8db84-6223-4e84-b9df-7a50601d3f03 service nova] Creating event network-changed:2633d7b8-bde0-4b89-ad15-c794d1a1ed93 for instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 on hv-cinder-74014 Aug 04 02:41:14.843506 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-5fb17e37-755b-4775-bb13-79236eb19ba2 req-0be8db84-6223-4e84-b9df-7a50601d3f03 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043264 Aug 04 02:41:14.844598 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 298/572] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:14.978732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:15.020413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6f2b7c1c-15bc-4482-84ca-a9e4a93b9b87 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Action: 'create', calling method: .version_select at 0x7fa6472f5160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-910917994", "metadata": {"Type": "work"}}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:15.480613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:15.481307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:15.487843 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:15.488832 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:15.489663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:15.490096 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:15.608695 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:15.633060 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=10 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:15.661139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:15.677572 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-da00ad23-6f7e-48f0-a94c-e6f681da6715 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.201392 Aug 04 02:41:15.678768 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 299/573] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:15 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:15.700020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6f2b7c1c-15bc-4482-84ca-a9e4a93b9b87 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.818539 Aug 04 02:41:15.700020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 275/574] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 4 02:41:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 820 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 02:41:15.703238 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-536a3a96-d431-4311-a911-5dc2d9de0351 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Calling method '.version_select at 0x7fa6461e41f0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:15.766206 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-536a3a96-d431-4311-a911-5dc2d9de0351 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d" status: 200 len: 352 microversion: 2.1 time: 0.066904 Aug 04 02:41:15.775000 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 300/575] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:41:15 2022] GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:15.776242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:15.776869 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:15.783973 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:15.784432 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:15.785885 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:15.786330 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:15.883460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=14 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:15.964347 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:15.972403 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-725d525f-3029-4297-bfc5-f6a341f1409a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.209979 Aug 04 02:41:15.973153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 276/576] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:15 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:16.699740 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:16.700444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:16.706503 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:16.707688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:16.708757 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:16.709195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:16.782805 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6915fa31-b39d-4961-a67b-66d7cbb2095b tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Calling method '.version_select at 0x7fa647260310>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:16.843832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6915fa31-b39d-4961-a67b-66d7cbb2095b tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d" status: 200 len: 353 microversion: 2.1 time: 0.065788 Aug 04 02:41:16.844671 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 277/577] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:41:16 2022] GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:16.858248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9a5c9368-5b3f-47a9-9a38-19e1dba6daf5 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Calling method '.version_select at 0x7fa6472a5b80>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:16.869183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:16.876947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3a9a4e76-2921-44b1-97ab-6b7c7e996ca2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.181793 Aug 04 02:41:16.877541 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 301/578] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:16 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:16.917261 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9a5c9368-5b3f-47a9-9a38-19e1dba6daf5 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d" status: 200 len: 353 microversion: 2.1 time: 0.062694 Aug 04 02:41:16.930897 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 278/579] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:41:16 2022] GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:41:16.938555 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2e5dcf98-e4cb-4b64-acf3-967b29fcfe19 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Calling method '.version_select at 0x7fa6461d5670>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:16.994077 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:16.999982 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:17.001438 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:17.001888 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:17.002692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:17.003373 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:17.131793 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2e5dcf98-e4cb-4b64-acf3-967b29fcfe19 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d" status: 202 len: 0 microversion: 2.1 time: 0.196914 Aug 04 02:41:17.132583 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 302/580] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:41:16 2022] DELETE /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:41:17.141008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c1e85593-b241-4149-b35c-9f55e8ab59e2 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Calling method '.version_select at 0x7fa6461d5ca0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:17.155937 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:17.166619 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-596f1483-1b9b-48fa-8096-dac9e62bccfb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.176562 Aug 04 02:41:17.178527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 279/581] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:16 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:17.205527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c1e85593-b241-4149-b35c-9f55e8ab59e2 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d" status: 200 len: 352 microversion: 2.1 time: 0.068469 Aug 04 02:41:17.206378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 303/582] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:41:17 2022] GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:17.897390 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:17.898017 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:17.904686 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:17.905943 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:17.905943 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:17.906368 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:18.188662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:18.189314 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:18.199174 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:18.199344 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:18.199627 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:18.200445 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:18.200865 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:18.208460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e93d88da-e941-46d6-b54f-b72a7d250a3d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.315038 Aug 04 02:41:18.210034 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 280/583] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:17 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:18.225642 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-39a21f6a-4384-4a23-8387-fd6e4671ec04 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Calling method '.version_select at 0x7fa64742cee0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:18.258730 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-39a21f6a-4384-4a23-8387-fd6e4671ec04 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] HTTP exception thrown: Volume f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d could not be found. Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-39a21f6a-4384-4a23-8387-fd6e4671ec04 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Request method failure captured: Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d HTTP/1.1 Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zHKNfwcav337E-Yr8pCa9oUnMdm35LvzNqRqWLJZp4RT_OP1zs1GJLYZU3spWQ5CIBstALsIcdshztMPJw_Q0vXe6d_QH2MPEAGDHj4SGuQbKIqCC3HrlkMDhp3WdORPevGZfAjI2W-ace0feWyQD-TjrhtF8iI_SRoiNfOLxODdtA Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 76d761a50cf1463b9b0666478ae67a3a Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesGetTestJSON-1026419028 Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:41:18.260879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76d761a50cf1463b9b0666478ae67a3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76d761a50cf1463b9b0666478ae67a3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_76d761a50cf1463b9b0666478ae67a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/76d761a50cf1463b9b0666478ae67a3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesGetTestJSON-1026419028 Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 76d761a50cf1463b9b0666478ae67a3a Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesGetTestJSON-1026419028 Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesGetTestJSON-1026419028-project Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: a25cbfe7a16340f0a178c167e2ca1be4 Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesGetTestJSON-1026419028-project Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Volume f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d could not be found. Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d'} Aug 04 02:41:18.262219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d could not be found. (HTTP 404) (Request-ID: req-3b26cfdc-1450-45ff-85ec-bb3f960d1e08) Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:41:18.263112 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:41:18.264326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d could not be found. Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:41:18.265417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d could not be found. Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d could not be found. Aug 04 02:41:18.266569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:41:18.269038 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-39a21f6a-4384-4a23-8387-fd6e4671ec04 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] Returning 404 to user: Volume f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:41:18.270766 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-39a21f6a-4384-4a23-8387-fd6e4671ec04 tempest-VolumesGetTestJSON-1026419028 tempest-VolumesGetTestJSON-1026419028-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d" status: 404 len: 109 microversion: 2.1 time: 0.049596 Aug 04 02:41:18.271434 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 281/584] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:41:18 2022] GET /compute/v2.1/os-volumes/f2c4bd7c-0c0d-4f6a-b72a-c9c3ef234d8d => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:41:18.346383 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:18.355096 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e87022df-055a-4045-918c-ec80010878f2 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.170864 Aug 04 02:41:18.355643 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 304/585] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:18 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:19.229949 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:19.230594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:19.237403 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:19.237859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:19.239286 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:19.239756 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:19.376422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:19.377378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:19.386554 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:19.386554 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:19.387016 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:19.387644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:19.388479 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:19.397631 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d0f16bb8-33e6-4da0-9b62-9da2f0b60cb7 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.172025 Aug 04 02:41:19.400332 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 282/586] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:19 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:19.522973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:19.530854 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-68136a21-02ff-400c-83b2-fa8640f66511 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.158242 Aug 04 02:41:19.531499 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 305/587] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:19 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:20.420096 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:20.420706 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:20.427470 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:20.427918 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:20.428694 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:20.429122 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:20.553465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:20.554088 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:20.561255 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:20.561572 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:20.562367 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:20.563026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:20.581561 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:20.589403 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1207f461-8a98-4053-976c-8eaca3727306 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.173157 Aug 04 02:41:20.589990 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 283/588] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:20 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:20.701601 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:20.709201 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-348e3951-2871-4d28-a723-3e8bd8c19d49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.160545 Aug 04 02:41:20.709772 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 306/589] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:20 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:21.609832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:21.610439 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:21.616962 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:21.627496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:21.627496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:21.627496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:21.729655 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:21.730268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:21.736797 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:21.737279 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:21.738076 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:21.738634 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:21.746535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:21.754526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8ab30b2c-fa2b-49dd-b5cb-11f8c43f63d2 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.147857 Aug 04 02:41:21.755386 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 284/590] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:21 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:21.872726 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:21.882464 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f06312b1-ca6c-4c69-bc9d-dabbc750009e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.156662 Aug 04 02:41:21.883175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 307/591] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:21 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:22.775879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:22.776409 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:22.787620 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:22.788168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:22.789026 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:22.789485 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:22.904058 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:22.904674 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:22.912733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:22.913189 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:22.913974 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:22.914418 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:22.936057 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:22.944359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-042bb003-7213-48ad-9034-020906907cb0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.172384 Aug 04 02:41:22.945002 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 285/592] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:22 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:23.055732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:23.065513 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-300832a2-4646-4e07-b762-b4bcfba032e5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.165347 Aug 04 02:41:23.066546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 308/593] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:22 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:23.813634 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-a73af8b4-1395-492f-99a9-af83307298f2 req-fa59d18f-52af-4ca2-96d7-44f79306a92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deddf119-039c-4060-a7bd-79554b9c1ba0", "name": "network-vif-plugged", "status": "completed", "tag": "c10bdcd9-3678-4c5c-92d6-0dbad937505d"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:23.824146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-a73af8b4-1395-492f-99a9-af83307298f2 req-fa59d18f-52af-4ca2-96d7-44f79306a92a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:23.824568 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-a73af8b4-1395-492f-99a9-af83307298f2 req-fa59d18f-52af-4ca2-96d7-44f79306a92a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:23.837285 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-a73af8b4-1395-492f-99a9-af83307298f2 req-fa59d18f-52af-4ca2-96d7-44f79306a92a service nova] Creating event network-vif-plugged:c10bdcd9-3678-4c5c-92d6-0dbad937505d for instance deddf119-039c-4060-a7bd-79554b9c1ba0 on hv-cinder-74014 Aug 04 02:41:23.842394 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-a73af8b4-1395-492f-99a9-af83307298f2 req-fa59d18f-52af-4ca2-96d7-44f79306a92a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032579 Aug 04 02:41:23.843072 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 286/594] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:23.965609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:23.966769 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:23.973566 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:23.980004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:23.980004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:23.980004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:24.088694 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:24.091171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:24.100056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:24.103850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:24.103850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:24.103850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:24.146330 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:24.155102 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f6e53f96-7b9b-4d58-b404-5a12bacca0a3 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.193761 Aug 04 02:41:24.156201 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 309/595] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:23 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:24.308435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:24.315966 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b931a4c7-0ece-4389-9aea-0f95da5fb776 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.232117 Aug 04 02:41:24.316846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 287/596] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:24 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:41:25.177723 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:25.178336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:25.188325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:25.188325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:25.188325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:25.188325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:25.324505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:25.332137 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d365bf36-8fda-4bdb-b98e-66aa06511183 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.159041 Aug 04 02:41:25.332710 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 310/597] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:25 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:25.337938 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:25.338908 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:25.345910 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:25.346431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:25.347273 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:25.347750 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:25.520257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:25.528052 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8ddb53c3-cd15-4264-a1d4-cb6f91548c8c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1359 microversion: 2.1 time: 0.194337 Aug 04 02:41:25.528880 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 288/598] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:25 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:25.857682 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-f35c8c69-c82d-4ce4-89ab-dec0c2272f90 req-b66dbcf6-b47e-4b0a-9492-f5c3333d1c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec4ee6a-83ae-412a-869e-6f2ef0d33553", "name": "network-vif-plugged", "status": "completed", "tag": "2633d7b8-bde0-4b89-ad15-c794d1a1ed93"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:25.868713 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-f35c8c69-c82d-4ce4-89ab-dec0c2272f90 req-b66dbcf6-b47e-4b0a-9492-f5c3333d1c31 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:25.869159 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-f35c8c69-c82d-4ce4-89ab-dec0c2272f90 req-b66dbcf6-b47e-4b0a-9492-f5c3333d1c31 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:25.881357 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-f35c8c69-c82d-4ce4-89ab-dec0c2272f90 req-b66dbcf6-b47e-4b0a-9492-f5c3333d1c31 service nova] Creating event network-vif-plugged:2633d7b8-bde0-4b89-ad15-c794d1a1ed93 for instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 on hv-cinder-74014 Aug 04 02:41:25.886352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-f35c8c69-c82d-4ce4-89ab-dec0c2272f90 req-b66dbcf6-b47e-4b0a-9492-f5c3333d1c31 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Aug 04 02:41:25.890020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 311/599] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:41:26.351675 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:26.352280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:26.358776 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.359226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:26.360086 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.360514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:26.501806 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:26.510165 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fd34e03b-3be7-4dfd-b7df-23adb5882a49 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.162388 Aug 04 02:41:26.510774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 289/600] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:26 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:26.550912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:26.552340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:26.558824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.559276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:26.560067 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.560484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:26.733809 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:26.742923 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-58392f43-125d-4661-8e21-b4d4228f79fe tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1549 microversion: 2.1 time: 0.197282 Aug 04 02:41:26.743508 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 312/601] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:26 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1549 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:26.763910 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:26.764529 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:26.772044 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.772044 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:26.772315 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.772543 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:26.911171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:26.918963 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-70e037cf-45ae-48c3-9089-5dc0bc921579 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1549 microversion: 2.1 time: 0.158774 Aug 04 02:41:26.920719 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 290/602] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:26 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:26.940493 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:26.945577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:26.946351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Searching by: {'deleted': False, 'project_id': 'b14b11a92ccb494ea480962861bac477'} {{(pid=124997) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 02:41:26.953200 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.953684 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:26.954512 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:26.954971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:27.044505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.multi_cell_list [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124997) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 02:41:27.070970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=100 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:27.140758 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d4ff9dfa-f28f-441f-9287-7f82cadd8b84 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204007 Aug 04 02:41:27.141383 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 313/603] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 4 02:41:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:27.157257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:27.157874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:27.164460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:27.164909 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:27.165700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:27.166134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:27.303094 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:27.311438 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f206dbb9-8d89-4f0d-b3c9-771782efa5cb tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1549 microversion: 2.1 time: 0.158266 Aug 04 02:41:27.311996 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 291/604] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:27 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:27.531430 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:27.531938 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:27.539038 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:27.539483 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:27.540244 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:27.540680 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:27.683975 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:27.691385 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7ed1af61-4571-4bb0-81bf-a1cd85eb78b1 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1362 microversion: 2.1 time: 0.164799 Aug 04 02:41:27.691949 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 314/605] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:27 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:28.711946 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:28.712565 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:28.719071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:28.719525 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:28.720378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:28.720825 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:29.019214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:29.027607 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3a62f5c3-d8a8-4307-ae13-721352e1a64a tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1548 microversion: 2.1 time: 0.320119 Aug 04 02:41:29.028450 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 292/606] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:28 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1548 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:29.055282 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5ad12df4-6649-4596-bf14-4012bcbea698 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:29.055652 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5ad12df4-6649-4596-bf14-4012bcbea698 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:29.062107 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ad12df4-6649-4596-bf14-4012bcbea698 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:29.062579 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ad12df4-6649-4596-bf14-4012bcbea698 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:29.063574 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ad12df4-6649-4596-bf14-4012bcbea698 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:29.064004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ad12df4-6649-4596-bf14-4012bcbea698 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:29.220621 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5ad12df4-6649-4596-bf14-4012bcbea698 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170864 Aug 04 02:41:29.221362 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 315/607] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:41:29 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:29.266172 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-756ca690-3678-4f01-8c55-fff733e41852 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "548d9cf6-2b3b-4bba-bb37-dcc5a76432c8"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:29.268592 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-756ca690-3678-4f01-8c55-fff733e41852 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:29.275442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-756ca690-3678-4f01-8c55-fff733e41852 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:29.275893 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-756ca690-3678-4f01-8c55-fff733e41852 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:29.276658 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-756ca690-3678-4f01-8c55-fff733e41852 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:29.277091 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-756ca690-3678-4f01-8c55-fff733e41852 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:30.029325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-756ca690-3678-4f01-8c55-fff733e41852 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766718 Aug 04 02:41:30.029967 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 293/608] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:41:29 2022] POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:30.322148 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-0a0f8c9d-dac2-4dd4-a7a5-a32332db2e57 req-7fb1f3ac-0f45-4ab8-8684-dacf8a6f3f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec4ee6a-83ae-412a-869e-6f2ef0d33553", "tag": "2633d7b8-bde0-4b89-ad15-c794d1a1ed93"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:30.331472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0a0f8c9d-dac2-4dd4-a7a5-a32332db2e57 req-7fb1f3ac-0f45-4ab8-8684-dacf8a6f3f05 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:30.331943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0a0f8c9d-dac2-4dd4-a7a5-a32332db2e57 req-7fb1f3ac-0f45-4ab8-8684-dacf8a6f3f05 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:30.343042 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-0a0f8c9d-dac2-4dd4-a7a5-a32332db2e57 req-7fb1f3ac-0f45-4ab8-8684-dacf8a6f3f05 service nova] Creating event network-changed:2633d7b8-bde0-4b89-ad15-c794d1a1ed93 for instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 on hv-cinder-74014 Aug 04 02:41:30.347871 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-0a0f8c9d-dac2-4dd4-a7a5-a32332db2e57 req-7fb1f3ac-0f45-4ab8-8684-dacf8a6f3f05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030607 Aug 04 02:41:30.348472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 316/609] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:32.352353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:32.353181 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:32.359785 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:32.360305 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:32.368668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:32.368668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:32.382284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:32.504076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:32.512162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-53b7f009-1934-4778-9d5d-f4c6ff4c0f01 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1595 microversion: 2.1 time: 0.165360 Aug 04 02:41:32.512952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 294/610] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:32 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1595 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:34.770783 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-591f1a78-cd42-4ff1-a434-ecca7009f777 req-c09991ec-4953-4c88-bbb8-8338baeaf828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deddf119-039c-4060-a7bd-79554b9c1ba0", "tag": "c10bdcd9-3678-4c5c-92d6-0dbad937505d"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:34.781604 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-591f1a78-cd42-4ff1-a434-ecca7009f777 req-c09991ec-4953-4c88-bbb8-8338baeaf828 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:34.782388 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-591f1a78-cd42-4ff1-a434-ecca7009f777 req-c09991ec-4953-4c88-bbb8-8338baeaf828 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:34.793751 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-591f1a78-cd42-4ff1-a434-ecca7009f777 req-c09991ec-4953-4c88-bbb8-8338baeaf828 service nova] Creating event network-changed:c10bdcd9-3678-4c5c-92d6-0dbad937505d for instance deddf119-039c-4060-a7bd-79554b9c1ba0 on hv-cinder-74014 Aug 04 02:41:34.798903 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-591f1a78-cd42-4ff1-a434-ecca7009f777 req-c09991ec-4953-4c88-bbb8-8338baeaf828 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033577 Aug 04 02:41:34.799761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 317/611] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:37.248298 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-124727833"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:37.248815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:37.251667 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:37.257371 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:37.262929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:37.262929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:37.262929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:37.468810 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.network.security_group_api [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Adding security group 225abd4c-e0b0-4f21-922b-c1500294ad81 to port c10bdcd9-3678-4c5c-92d6-0dbad937505d Aug 04 02:41:38.184771 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-35788c0f-c6d4-41c1-a813-993c8126a01f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.940671 Aug 04 02:41:38.185935 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 295/612] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:41:37 2022] POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/action => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:41:38.195018 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-f0b5a9b5-5084-40e6-9686-45c700c3b66c req-bdcae9f9-81db-49b5-9aa7-daa21b2813f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deddf119-039c-4060-a7bd-79554b9c1ba0", "tag": "c10bdcd9-3678-4c5c-92d6-0dbad937505d"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:38.197535 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:38.198917 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:38.206050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:38.206597 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-f0b5a9b5-5084-40e6-9686-45c700c3b66c req-bdcae9f9-81db-49b5-9aa7-daa21b2813f2 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:38.207239 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-f0b5a9b5-5084-40e6-9686-45c700c3b66c req-bdcae9f9-81db-49b5-9aa7-daa21b2813f2 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:38.207529 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:38.209839 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:38.210462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:38.211353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:38.212105 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:38.223329 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-f0b5a9b5-5084-40e6-9686-45c700c3b66c req-bdcae9f9-81db-49b5-9aa7-daa21b2813f2 service nova] Creating event network-changed:c10bdcd9-3678-4c5c-92d6-0dbad937505d for instance deddf119-039c-4060-a7bd-79554b9c1ba0 on hv-cinder-74014 Aug 04 02:41:38.229505 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-f0b5a9b5-5084-40e6-9686-45c700c3b66c req-bdcae9f9-81db-49b5-9aa7-daa21b2813f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038037 Aug 04 02:41:38.230595 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 296/613] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:41:38.415130 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:38.432746 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-281d4104-7da2-4e39-bcaa-c05d672a5451 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1760 microversion: 2.1 time: 0.235902 Aug 04 02:41:38.432746 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 318/614] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:41:38 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1760 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:41:43.968656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c000546b-7027-4c7e-a207-4a3a5b05ecde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:43.969240 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c000546b-7027-4c7e-a207-4a3a5b05ecde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:43.975503 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c000546b-7027-4c7e-a207-4a3a5b05ecde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:43.975948 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c000546b-7027-4c7e-a207-4a3a5b05ecde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:43.976707 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c000546b-7027-4c7e-a207-4a3a5b05ecde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:43.977143 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c000546b-7027-4c7e-a207-4a3a5b05ecde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:43.999832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c000546b-7027-4c7e-a207-4a3a5b05ecde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/ips" status: 200 len: 153 microversion: 2.20 time: 0.035943 Aug 04 02:41:44.000398 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 297/615] 10.222.0.60 () {60 vars in 1289 bytes} [Thu Aug 4 02:41:43 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:41:46.817134 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:41:46.817788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:46.823976 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:46.824421 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:46.825173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:46.825601 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:46.850680 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lazy-loading 'flavor' on Instance uuid ffa07bb4-3207-4fba-bb58-46ba0452ca16 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:41:47.304344 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a2311f04-ae43-4819-846d-0790ab166756 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/action" status: 202 len: 0 microversion: 2.20 time: 0.490869 Aug 04 02:41:47.304889 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 319/616] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 4 02:41:46 2022] POST /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:41:47.314146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:47.319240 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:47.322216 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:47.322702 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:47.323482 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:47.323923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:47.473663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:47.474094 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:47.475659 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:47.476815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9e8565cd-84f9-450e-98b6-b29eac9e0b6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.167593 Aug 04 02:41:47.477371 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 298/617] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:47 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:48.502447 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:48.503168 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:48.509832 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:48.510273 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:48.511234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:48.511746 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:48.650078 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:48.658378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:48.659925 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:48.661094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fb4a3e60-69c5-4399-9f9a-76aff4d77cb6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.163549 Aug 04 02:41:48.661783 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 320/618] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:48 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:49.912980 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:49.916318 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:49.919545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:49.919988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:49.920745 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:49.921171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:50.059080 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:50.067164 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:50.069304 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:50.070462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8808fd87-7ed7-47ab-a96a-fa2a4b5036ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.389270 Aug 04 02:41:50.071270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 299/619] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:49 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:41:51.093946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:51.094659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:51.101897 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:51.102474 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:51.103306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:51.103742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:51.239102 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:51.247252 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:51.248674 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:51.249821 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-94a529e2-2a49-47ae-8d4a-d8829c823cde tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.159928 Aug 04 02:41:51.250424 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 321/620] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:51 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:52.273049 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:52.273603 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:52.280241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:52.280688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:52.281445 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:52.281880 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:52.415545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:52.423562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:52.425055 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:52.426201 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fbc07a61-faf4-4e30-9dbb-38dc3bead1ea tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.157311 Aug 04 02:41:52.426792 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 300/621] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:52 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:53.449815 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:53.450418 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:53.456774 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:53.457219 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:53.457970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:53.458401 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:53.587527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:53.595416 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:53.596911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:53.598056 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1b1f1950-4e23-408c-92e6-2cb626d91375 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.152230 Aug 04 02:41:53.598637 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 322/622] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:53 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:54.623412 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:54.624066 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:54.630429 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:54.630899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:54.631682 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:54.632151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:54.764056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:54.772140 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:54.777422 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:54.779637 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-710fc83e-1a73-4831-b3d2-92d24687866e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.160133 Aug 04 02:41:54.780586 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 301/623] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:54 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:55.804619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:55.805235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:55.811379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:55.811858 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:55.812614 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:55.813047 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:55.950627 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:55.958862 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:55.960799 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:55.962084 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f6815088-d870-4195-a0bb-213612034c18 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.162157 Aug 04 02:41:55.962920 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 323/624] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:55 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:56.985058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:56.985701 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:56.992100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:56.992535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:56.993289 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:56.993749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:57.126035 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:57.140820 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:57.142383 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:57.146232 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-916a3b9d-06a2-42ae-a499-b23569f62ea2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.162495 Aug 04 02:41:57.146232 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 302/625] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:56 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:58.168956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:58.169650 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:58.176330 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:58.176786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:58.177709 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:58.178164 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:58.181859 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:58.318700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:58.326720 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:58.328233 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:58.329427 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1a321ce9-27bb-499a-afb5-54186c28c69c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1747 microversion: 2.20 time: 0.164433 Aug 04 02:41:58.329908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 324/626] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:58 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:41:59.352182 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:41:59.352853 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:41:59.359532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:59.359989 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:59.363623 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:41:59.364083 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:41:59.516650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:59.524827 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:59.526315 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:41:59.527499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6e7a9baf-3ab9-49e4-9f65-f2d40c3fe800 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1747 microversion: 2.20 time: 0.179340 Aug 04 02:41:59.528062 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 303/627] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:41:59 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1747 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:00.552316 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:00.552913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:00.559628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:00.560072 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:00.560856 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:00.561284 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:00.601522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:00.602194 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:00.608791 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:00.609389 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:00.610162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:00.610621 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:00.634002 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lazy-loading 'flavor' on Instance uuid 680f726e-1314-4d14-a8e1-1752f6efc2f3 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:42:00.693097 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:00.701790 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:00.703400 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:00.704547 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fda58422-aa3e-45ff-94a4-94b99882024d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1747 microversion: 2.20 time: 0.156531 Aug 04 02:42:00.705104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 325/628] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:00 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:00.892985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fa9358a6-ff84-4e4b-8d34-50fda272e863 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "POST /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3/action" status: 202 len: 0 microversion: 2.1 time: 0.295152 Aug 04 02:42:00.893597 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 304/629] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:42:00 2022] POST /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:42:00.902635 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:00.903766 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:00.909867 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:00.910313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:00.911110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:00.911550 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:01.064340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:01.074300 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a95afd61-59f9-4c34-90cd-612d9c895447 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.175217 Aug 04 02:42:01.075093 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 326/630] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:00 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:01.328114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-ac2f955b-9a51-4ade-a669-466c38dad1e6 req-227f1f5e-95be-46ff-a3bd-c963f936b2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa07bb4-3207-4fba-bb58-46ba0452ca16", "name": "network-vif-plugged", "status": "completed", "tag": "9e4ea6f4-5972-44dc-a2ca-c3771cc56a76"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:01.338360 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-ac2f955b-9a51-4ade-a669-466c38dad1e6 req-227f1f5e-95be-46ff-a3bd-c963f936b2db service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:01.338834 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-ac2f955b-9a51-4ade-a669-466c38dad1e6 req-227f1f5e-95be-46ff-a3bd-c963f936b2db service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:01.352791 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-ac2f955b-9a51-4ade-a669-466c38dad1e6 req-227f1f5e-95be-46ff-a3bd-c963f936b2db service nova] Creating event network-vif-plugged:9e4ea6f4-5972-44dc-a2ca-c3771cc56a76 for instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 on hv-cinder-74014 Aug 04 02:42:01.358272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-ac2f955b-9a51-4ade-a669-466c38dad1e6 req-227f1f5e-95be-46ff-a3bd-c963f936b2db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034031 Aug 04 02:42:01.358811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 305/631] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:01.728045 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:01.728714 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:01.735546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:01.736030 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:01.736835 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:01.737272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:01.888434 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:01.898089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:01.899947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:01.901309 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fb022c00-d213-4c0c-831e-5ed747d97e3c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.177444 Aug 04 02:42:01.902032 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 327/632] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:01 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:02.095977 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:02.097665 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:02.105400 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:02.106084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:02.106955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:02.107660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:02.265040 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:02.276864 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0a2c7c40-995a-46c2-857a-c7bcecd401fb tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.185415 Aug 04 02:42:02.277731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 306/633] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:02 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:02.928354 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:02.929463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:02.936404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:02.936921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:02.937914 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:02.938625 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:03.130682 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:03.144380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:03.146198 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:03.148928 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-89cfa162-bfd6-4248-8787-a7895c9833fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.224422 Aug 04 02:42:03.163789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 328/634] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:02 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:03.302969 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:03.304749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:03.312931 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:03.320134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:03.320134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:03.320134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:03.483362 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:03.492506 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-cfff5770-5b90-4a85-a0d0-bdf24918a1e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.193533 Aug 04 02:42:03.493693 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 307/635] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:03 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:04.175549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:04.176149 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:04.185197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:04.185197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:04.195038 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:04.195894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:04.374775 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:04.378089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:04.379824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:04.381433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d21c62b8-81bd-45a4-be75-72e785547dc3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.210498 Aug 04 02:42:04.399136 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 329/636] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:04 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:04.526923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:04.527494 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:04.534444 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:04.534928 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:04.535705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:04.536167 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:04.680627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:04.688318 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4bd69d2c-55fb-4f8c-babe-218bf5e55baa tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.169376 Aug 04 02:42:04.689122 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 308/637] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:04 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:05.405194 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:05.407480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:05.419379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:05.420071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:05.421003 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:05.421588 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:05.579889 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:05.591091 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:05.593086 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:05.594476 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-58947b6a-6d97-4d84-a778-3c2e8156a02f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.193415 Aug 04 02:42:05.595245 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 330/638] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:05 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:05.709324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:05.710955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:05.717541 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:05.718242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:05.719133 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:05.719576 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:05.873139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:05.881598 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2f942454-b7b8-48ed-8076-fac6cb2f70d3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.176179 Aug 04 02:42:05.883841 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 309/639] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:05 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:06.619484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:06.622025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:06.630624 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:06.631071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:06.631895 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:06.632623 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:06.791542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:06.806033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:06.806033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:06.807211 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4f2183a1-b86e-406a-bdaf-f567ffc45c0d tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.192567 Aug 04 02:42:06.807998 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 331/640] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:06 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:06.909144 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:06.910649 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:06.920176 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:06.920816 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:06.921659 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:06.922327 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:07.080114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:07.089542 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4f8d1508-5f41-4c31-b390-83382b02649c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.188841 Aug 04 02:42:07.092991 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 310/641] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:06 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:07.831246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:07.831890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:07.838595 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:07.839040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:07.839801 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:07.840236 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:07.975555 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:07.983912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:07.985435 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:07.986628 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-99086c78-ce3a-44a8-8c95-e8375606b14b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.159291 Aug 04 02:42:07.987193 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 332/642] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:07 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:08.112333 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:08.112900 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:08.115272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=32 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:08.120959 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:08.121428 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:08.124729 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:08.125207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:08.128157 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:08.272336 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:08.281085 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-18162f92-a27f-4ba7-a7e1-09864faf3132 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.172630 Aug 04 02:42:08.297978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 311/643] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:08 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:09.011097 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:09.012515 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:09.015030 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=30 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:09.020076 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:09.020529 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:09.021501 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:09.021957 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:09.187869 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:09.197314 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:09.198908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:09.200088 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-58f20ff0-09a0-440b-bc66-ee0924955ab3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.192941 Aug 04 02:42:09.200996 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 333/644] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:09 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:09.308683 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:09.309398 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:09.316820 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:09.317629 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:09.318594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:09.319462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:09.489326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:09.498628 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bf507a74-2fd6-4022-a41a-fa00beb2fe0f tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.197248 Aug 04 02:42:09.499211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 312/645] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:09 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:10.224241 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:10.224936 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:10.233970 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:10.234842 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:10.235842 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:10.237307 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:10.384511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:10.395128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:10.398028 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:10.398948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-666df5ea-9ea2-4fad-ad79-914038a7848c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.179410 Aug 04 02:42:10.399707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 334/646] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:10 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:10.520516 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:10.521258 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:10.528925 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:10.532317 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:10.535785 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:10.535785 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:10.697332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-da0f99c1-0da7-4870-a246-095c3dcfe603 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:10.699755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-da0f99c1-0da7-4870-a246-095c3dcfe603 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:10.704018 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:10.712484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da0f99c1-0da7-4870-a246-095c3dcfe603 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:10.715763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da0f99c1-0da7-4870-a246-095c3dcfe603 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:10.715763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da0f99c1-0da7-4870-a246-095c3dcfe603 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:10.715763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da0f99c1-0da7-4870-a246-095c3dcfe603 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:10.720897 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-04f89bb0-69e1-4acf-a3de-190808ac445c tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.204021 Aug 04 02:42:10.736882 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 313/647] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:10 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:11.422916 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:11.423541 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:11.429656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:11.430106 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:11.430912 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:11.431349 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:11.628890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:11.637407 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:11.639024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:11.640179 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f79dfeb5-466b-4a6d-8dcd-f9a8b702083e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.221239 Aug 04 02:42:11.640738 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 314/648] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:11 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:42:11.746603 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:11.747242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:11.754158 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:11.756415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:11.756415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:11.756415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:11.846539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-da0f99c1-0da7-4870-a246-095c3dcfe603 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/action" status: 202 len: 0 microversion: 2.1 time: 1.156418 Aug 04 02:42:11.850931 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 335/649] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:42:10 2022] POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/action => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:42:11.856159 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:11.856849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:11.863386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:11.863828 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:11.864592 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:11.865206 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:11.912786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:11.922432 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a1db06a3-7a36-4354-8d87-af23cfb98db3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.179658 Aug 04 02:42:11.923048 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 315/650] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:11 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:12.017659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:12.026569 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f46b5f7b-535f-44df-93cd-ac7ca231013f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1752 microversion: 2.1 time: 0.174431 Aug 04 02:42:12.027139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 336/651] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:11 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:12.665231 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:12.665996 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:12.673356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:12.673795 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:12.674945 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:12.675386 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:12.825183 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:12.833781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:12.839553 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:12.841113 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-63dc541e-b791-41d0-a8bc-f0ad36854f38 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1742 microversion: 2.20 time: 0.180664 Aug 04 02:42:12.841780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 316/652] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:12 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:12.944239 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:12.945435 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:12.955384 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:12.955838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:12.956646 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:12.957087 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:13.049306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:13.050129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:13.057176 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:13.057628 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:13.058404 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:13.058899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:13.098633 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:13.106957 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c23e27de-c3d2-464b-8464-e23400201b18 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.167138 Aug 04 02:42:13.107534 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 337/653] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:12 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:13.212771 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:13.220919 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7e01a87b-5857-43ed-9a70-ae6d2cc18b4b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1752 microversion: 2.1 time: 0.175591 Aug 04 02:42:13.225988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 317/654] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:13 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:13.868368 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:13.868368 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:13.872118 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:13.872573 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:13.873366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:13.873952 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:14.014473 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:14.022865 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:14.025041 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:14.026209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3f755c43-ebb4-4049-8fb8-0ea1921725dc tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1724 microversion: 2.20 time: 0.165051 Aug 04 02:42:14.026806 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 338/655] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:13 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:14.129197 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:14.132872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:14.139606 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:14.140066 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:14.140851 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:14.141290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:14.412491 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-524fbb8d-ab82-489f-851d-fe438cc8ea87 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:14.413493 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-524fbb8d-ab82-489f-851d-fe438cc8ea87 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:14.419864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-524fbb8d-ab82-489f-851d-fe438cc8ea87 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:14.420338 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-524fbb8d-ab82-489f-851d-fe438cc8ea87 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:14.421175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-524fbb8d-ab82-489f-851d-fe438cc8ea87 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:14.421747 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-524fbb8d-ab82-489f-851d-fe438cc8ea87 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:14.445512 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-524fbb8d-ab82-489f-851d-fe438cc8ea87 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/ips" status: 200 len: 145 microversion: 2.1 time: 0.220209 Aug 04 02:42:14.447058 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 339/656] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:42:14 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/ips => generated 145 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:42:14.452295 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:14.456225 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:14.462964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:14.467576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:14.467576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:14.467576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:14.469030 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:14.528243 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:14.538402 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d9b693e3-a763-4afb-aa08-38b51bde591b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.413399 Aug 04 02:42:14.539179 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 318/657] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:14 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:14.620897 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:14.628876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-efe0052e-c4d6-4ef9-9042-f1a652599b77 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1752 microversion: 2.1 time: 0.180978 Aug 04 02:42:14.629472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 340/658] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:14 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:15.053799 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:15.054546 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:15.061660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.062108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.063053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.063493 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.192944 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:15.200992 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:15.204571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:15.204571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-66b507ab-776e-4a8f-97f2-a20b49ce085e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1724 microversion: 2.20 time: 0.153795 Aug 04 02:42:15.204571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 319/659] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:15 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:15.560749 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:15.561300 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:15.567873 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.569245 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.569245 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.569480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.650912 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:15.651618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:15.657914 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.658367 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.659176 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.660933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.699248 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:15.706916 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-28236990-5c16-48a9-83a6-6b42f7b93347 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1510 microversion: 2.1 time: 0.150322 Aug 04 02:42:15.707539 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 341/660] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:15 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:15.731353 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:15.731946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:15.738019 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.738468 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.739262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:15.739692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:15.812994 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:15.823461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b8a20c16-1fe6-4ac6-9b57-187b993ea342 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.176222 Aug 04 02:42:15.824395 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 320/661] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:15 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:15.833218 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124997) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 02:42:16.064939 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6e08f677-0ccb-42d4-862e-a557e2369555 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5ddcc55-810d-4a5e-ba8b-052e07b23da3"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:16.067325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6e08f677-0ccb-42d4-862e-a557e2369555 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:16.073828 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e08f677-0ccb-42d4-862e-a557e2369555 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.074358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e08f677-0ccb-42d4-862e-a557e2369555 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:16.075163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e08f677-0ccb-42d4-862e-a557e2369555 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.075605 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6e08f677-0ccb-42d4-862e-a557e2369555 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:16.084207 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-34699b41-d299-4169-b77a-d4d943b048d1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "POST /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3/action" status: 202 len: 0 microversion: 2.1 time: 0.357190 Aug 04 02:42:16.084822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 342/662] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:42:15 2022] POST /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:42:16.093777 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:16.094904 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:16.100991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.101755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:16.102844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.103364 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:16.251259 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:16.259548 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d99cae17-7479-4320-a5ea-73ed534f0dc1 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1518 microversion: 2.1 time: 0.169529 Aug 04 02:42:16.260125 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 343/663] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:16 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:16.265465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:16.265465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:16.271796 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.272239 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:16.273005 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.273544 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:16.409781 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:16.417771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:16.419321 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:16.420477 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b354b7c1-c420-48e4-a4fb-b013fffe854a tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1724 microversion: 2.20 time: 0.159437 Aug 04 02:42:16.421032 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 344/664] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:16 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:16.846367 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:16.847057 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:16.853626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.854078 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:16.854883 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:16.855333 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:17.003772 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:17.012384 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-01cf6c66-272d-49ed-8b8e-32056926996e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.170738 Aug 04 02:42:17.014590 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 345/665] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:16 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:17.257328 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6e08f677-0ccb-42d4-862e-a557e2369555 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.196546 Aug 04 02:42:17.260264 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 321/666] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:42:16 2022] POST /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments => generated 194 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:42:17.282062 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:17.286965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:17.290034 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:17.290683 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:17.291535 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:17.291971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:17.292486 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-045b64a5-cd43-4daa-8645-12b5887af641 req-a9013abd-283c-4f58-ac67-fe7bc8d1b086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa07bb4-3207-4fba-bb58-46ba0452ca16", "name": "network-vif-unplugged", "status": "completed", "tag": "9e4ea6f4-5972-44dc-a2ca-c3771cc56a76"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:17.311381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-045b64a5-cd43-4daa-8645-12b5887af641 req-a9013abd-283c-4f58-ac67-fe7bc8d1b086 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:17.311821 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-045b64a5-cd43-4daa-8645-12b5887af641 req-a9013abd-283c-4f58-ac67-fe7bc8d1b086 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:17.341961 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-045b64a5-cd43-4daa-8645-12b5887af641 req-a9013abd-283c-4f58-ac67-fe7bc8d1b086 service nova] Creating event network-vif-unplugged:9e4ea6f4-5972-44dc-a2ca-c3771cc56a76 for instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 on hv-cinder-74014 Aug 04 02:42:17.347837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-045b64a5-cd43-4daa-8645-12b5887af641 req-a9013abd-283c-4f58-ac67-fe7bc8d1b086 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125389 Aug 04 02:42:17.348730 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 346/667] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:42:17.444151 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:17.449955 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:17.450585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:17.459062 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d529f793-5f87-46f2-9c2c-d514c0ae76a5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1520 microversion: 2.1 time: 0.181350 Aug 04 02:42:17.462569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 322/668] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:17 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:17.462733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:17.462733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:17.462733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:17.463115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:17.636555 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:17.645637 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:17.647186 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:17.648462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6aa41454-698a-4d36-abb5-8c07e9efd3ed tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1727 microversion: 2.20 time: 0.208546 Aug 04 02:42:17.649028 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 347/669] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:17 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:42:17.673700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fef16b58-628e-45a1-8c84-5ca3c88277a6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c10b9d-775c-4177-939e-55a7c1fb7905"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:17.676328 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fef16b58-628e-45a1-8c84-5ca3c88277a6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:17.683234 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fef16b58-628e-45a1-8c84-5ca3c88277a6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:17.683522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fef16b58-628e-45a1-8c84-5ca3c88277a6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:17.684295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fef16b58-628e-45a1-8c84-5ca3c88277a6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:17.684850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fef16b58-628e-45a1-8c84-5ca3c88277a6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:18.033330 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:18.033979 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:18.040661 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:18.041104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:18.041862 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:18.042290 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:18.194107 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:18.203010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ab7eef13-4a87-4e6d-b306-1fc35775d85f tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.173435 Aug 04 02:42:18.210068 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 348/670] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:18 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:18.481360 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:18.481898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:18.488066 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:18.488518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:18.489296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:18.489733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:18.624078 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:18.631755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-21cffe29-31d8-405b-8cb3-91617e21fe74 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1520 microversion: 2.1 time: 0.154994 Aug 04 02:42:18.632322 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 349/671] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:18 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:18.822562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:18.899640 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fef16b58-628e-45a1-8c84-5ca3c88277a6 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.229705 Aug 04 02:42:18.900295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 323/672] 10.222.0.60 () {62 vars in 1364 bytes} [Thu Aug 4 02:42:17 2022] POST /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-volume_attachments => generated 188 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:42:19.027743 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-84a52e1c-cdc9-4f36-990b-8f77a37e165f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:19.028239 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-84a52e1c-cdc9-4f36-990b-8f77a37e165f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:19.034708 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84a52e1c-cdc9-4f36-990b-8f77a37e165f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.035262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84a52e1c-cdc9-4f36-990b-8f77a37e165f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.035933 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84a52e1c-cdc9-4f36-990b-8f77a37e165f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.036371 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-84a52e1c-cdc9-4f36-990b-8f77a37e165f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.225015 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:19.225632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:19.235314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.235693 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.237315 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.237758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.503509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:19.519184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c7bc939c-c498-4db6-a687-a8aee0a4faa6 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.291907 Aug 04 02:42:19.519184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 324/673] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:19 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:19.519184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-72d54984-fdbd-4120-b635-05cc984625f5 req-c0d9e769-8a7f-48bb-a72f-b2402d3d1931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680f726e-1314-4d14-a8e1-1752f6efc2f3", "name": "network-vif-unplugged", "status": "completed", "tag": "297fbec7-3f62-4364-b1a7-6b0b689eede7"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:19.531499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-72d54984-fdbd-4120-b635-05cc984625f5 req-c0d9e769-8a7f-48bb-a72f-b2402d3d1931 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.531932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-72d54984-fdbd-4120-b635-05cc984625f5 req-c0d9e769-8a7f-48bb-a72f-b2402d3d1931 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.544906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-72d54984-fdbd-4120-b635-05cc984625f5 req-c0d9e769-8a7f-48bb-a72f-b2402d3d1931 service nova] Creating event network-vif-unplugged:297fbec7-3f62-4364-b1a7-6b0b689eede7 for instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 on hv-cinder-74014 Aug 04 02:42:19.550169 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-72d54984-fdbd-4120-b635-05cc984625f5 req-c0d9e769-8a7f-48bb-a72f-b2402d3d1931 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035411 Aug 04 02:42:19.551145 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 325/674] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:19.561193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-691497b9-a9aa-4c13-942f-3a97820e3700 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:19.561193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-691497b9-a9aa-4c13-942f-3a97820e3700 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:19.568313 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-691497b9-a9aa-4c13-942f-3a97820e3700 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.569618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-691497b9-a9aa-4c13-942f-3a97820e3700 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.570394 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-691497b9-a9aa-4c13-942f-3a97820e3700 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.571562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-691497b9-a9aa-4c13-942f-3a97820e3700 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.604463 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-691497b9-a9aa-4c13-942f-3a97820e3700 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051212 Aug 04 02:42:19.605135 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 326/675] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:42:19 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:19.615698 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-68518ff1-eeea-48cf-b5e4-8ddf8cac4dea tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:19.616287 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-68518ff1-eeea-48cf-b5e4-8ddf8cac4dea tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:19.623406 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-68518ff1-eeea-48cf-b5e4-8ddf8cac4dea tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.623861 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-68518ff1-eeea-48cf-b5e4-8ddf8cac4dea tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.624634 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-68518ff1-eeea-48cf-b5e4-8ddf8cac4dea tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.625108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-68518ff1-eeea-48cf-b5e4-8ddf8cac4dea tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.656269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-68518ff1-eeea-48cf-b5e4-8ddf8cac4dea tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/b5ddcc55-810d-4a5e-ba8b-052e07b23da3" status: 200 len: 194 microversion: 2.1 time: 0.044455 Aug 04 02:42:19.656905 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 327/676] 10.222.0.60 () {58 vars in 1413 bytes} [Thu Aug 4 02:42:19 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/b5ddcc55-810d-4a5e-ba8b-052e07b23da3 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:19.666770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:19.667505 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:19.673906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.674358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.675156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.675728 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.676141 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-84a52e1c-cdc9-4f36-990b-8f77a37e165f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-volume_attachments/d1c10b9d-775c-4177-939e-55a7c1fb7905" status: 202 len: 0 microversion: 2.20 time: 0.652792 Aug 04 02:42:19.677861 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 350/677] 10.222.0.60 () {60 vars in 1457 bytes} [Thu Aug 4 02:42:19 2022] DELETE /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-volume_attachments/d1c10b9d-775c-4177-939e-55a7c1fb7905 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:42:19.742251 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:19.743150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:19.749144 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.749592 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.750362 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:19.750905 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:19.783791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124997) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 02:42:19.904017 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:19.913796 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-76473ba6-4cb3-423c-b24a-8c3dfdf076ca tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.255882 Aug 04 02:42:19.918687 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 328/678] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:19 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:20.084050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2d545231-1fb0-42e0-abae-6b8bf1f97c28 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "POST /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/action" status: 202 len: 0 microversion: 2.20 time: 0.345707 Aug 04 02:42:20.084932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 351/679] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 4 02:42:19 2022] POST /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:42:20.093650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:20.094267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:20.100360 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:20.100814 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:20.101584 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:20.102024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:20.233353 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:20.241392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:20.243309 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:20.244470 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b70dd6a2-e9d0-48a5-995f-17e82964197e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1675 microversion: 2.20 time: 0.154923 Aug 04 02:42:20.245047 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 329/680] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:20 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:20.537556 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:20.538150 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:20.544360 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:20.544803 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:20.550214 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:20.550214 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:20.697479 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:20.704544 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:20.709677 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7f6395f9-d5c9-4033-ae2a-55ae7eb7442b tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.176058 Aug 04 02:42:20.710406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 352/681] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:20 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:20.936840 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:20.937451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:20.944037 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:20.944396 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:20.945150 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:20.945580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:21.081440 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:21.089207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-12e653d4-8712-48bc-b80e-88359c4c8707 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.156199 Aug 04 02:42:21.089777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 330/682] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:20 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:21.268725 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:21.269339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:21.276976 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:21.277431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:21.278202 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:21.278916 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:21.413094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:21.418434 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ed2de7ed-1b03-42bd-ac46-918d6a36f5aa tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fff87cc-074b-4a66-bed2-078a0d251ff0"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:21.420887 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ed2de7ed-1b03-42bd-ac46-918d6a36f5aa tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:21.422396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:21.424219 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:21.426457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-72d48785-2ca1-4777-8df7-1cb96aa6cf6b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1675 microversion: 2.20 time: 0.161703 Aug 04 02:42:21.432685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ed2de7ed-1b03-42bd-ac46-918d6a36f5aa tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:21.432975 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 353/683] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:21 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:21.433089 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ed2de7ed-1b03-42bd-ac46-918d6a36f5aa tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:21.433089 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ed2de7ed-1b03-42bd-ac46-918d6a36f5aa tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:21.433089 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ed2de7ed-1b03-42bd-ac46-918d6a36f5aa tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:21.732320 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:21.733306 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:21.740675 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:21.741131 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:21.741991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:21.742426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:21.892356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:21.900941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0234c153-93f5-40e9-a4b3-95d80200e567 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.172729 Aug 04 02:42:21.901563 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 354/684] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:21 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:22.046336 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ed2de7ed-1b03-42bd-ac46-918d6a36f5aa tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "POST /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632628 Aug 04 02:42:22.048974 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 331/685] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:42:21 2022] POST /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:42:22.110325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:22.110964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:22.116846 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:22.117860 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:22.118927 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:22.119361 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:22.454250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:22.455116 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:22.465907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:22.466361 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:22.467374 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:22.467967 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:22.510786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:22.518931 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c76ea01b-4a32-4ae6-81e9-6a7e0ad9d62b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.412259 Aug 04 02:42:22.519511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 355/686] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:22 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:22.707465 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:22.715894 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:22.717385 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:22.718564 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-92eda292-d613-4154-9f09-58feadd567b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.272316 Aug 04 02:42:22.719129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 332/687] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:22 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:22.922824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:22.923443 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:22.929469 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:22.930603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:22.931451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:22.931891 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:23.075042 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:23.082960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-96d5d9b4-d1d8-4daf-a3f1-59dc01003e5e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.164021 Aug 04 02:42:23.083530 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 356/688] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:22 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:23.540848 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:23.541466 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:23.547941 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:23.548391 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:23.549155 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:23.549591 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:23.679408 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:23.687410 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-cd84793a-5d20-4f4b-81ed-e525147c686b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.150934 Aug 04 02:42:23.688331 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 333/689] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:23 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:23.741324 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:23.742196 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:23.749237 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:23.749775 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:23.750812 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:23.751328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:23.882538 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:23.891362 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:23.892913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:23.894084 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-dfe58402-6261-4f4e-9120-de6942241ec7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.156731 Aug 04 02:42:23.894669 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 357/690] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:23 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:24.105011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:24.105698 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:24.111878 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:24.112439 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:24.113298 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:24.113860 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:24.276085 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:24.284312 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-14804543-b01e-45ee-92dd-f640c5f80ea4 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.183748 Aug 04 02:42:24.285162 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 334/691] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:24 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:24.708866 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:24.709999 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:24.716978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:24.717518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:24.718361 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:24.719180 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:24.870781 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:24.879228 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b251a165-b6be-49fd-b13e-3ea18086e68b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.174484 Aug 04 02:42:24.879847 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 358/692] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:24 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:24.921261 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:24.921941 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:24.930866 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:24.931320 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:24.932106 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:24.932547 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.073805 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:25.082985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:25.088650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:25.089998 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-da90dd02-2c55-4a45-9774-8442544ddfa9 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.173128 Aug 04 02:42:25.090909 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 335/693] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:24 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:42:25.305336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:25.306120 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:25.327660 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.329516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.332614 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.333279 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.376210 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-cddc2982-db07-4192-92b5-cc9b5519b3c5 req-0a9b54ba-d3b1-4ddb-91cb-1916bc9c5c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680f726e-1314-4d14-a8e1-1752f6efc2f3", "name": "network-vif-plugged", "status": "completed", "tag": "297fbec7-3f62-4364-b1a7-6b0b689eede7"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:25.409058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-cddc2982-db07-4192-92b5-cc9b5519b3c5 req-0a9b54ba-d3b1-4ddb-91cb-1916bc9c5c54 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.409496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-cddc2982-db07-4192-92b5-cc9b5519b3c5 req-0a9b54ba-d3b1-4ddb-91cb-1916bc9c5c54 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.442343 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-cddc2982-db07-4192-92b5-cc9b5519b3c5 req-0a9b54ba-d3b1-4ddb-91cb-1916bc9c5c54 service nova] Creating event network-vif-plugged:297fbec7-3f62-4364-b1a7-6b0b689eede7 for instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 on hv-cinder-74014 Aug 04 02:42:25.448943 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-cddc2982-db07-4192-92b5-cc9b5519b3c5 req-0a9b54ba-d3b1-4ddb-91cb-1916bc9c5c54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076526 Aug 04 02:42:25.460600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 336/694] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:42:25.480408 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c1b1d664-6967-4624-b81d-c9af95cae4b0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:25.485346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c1b1d664-6967-4624-b81d-c9af95cae4b0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:25.498548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c1b1d664-6967-4624-b81d-c9af95cae4b0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.499651 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c1b1d664-6967-4624-b81d-c9af95cae4b0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.500647 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c1b1d664-6967-4624-b81d-c9af95cae4b0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.501272 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c1b1d664-6967-4624-b81d-c9af95cae4b0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.563325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c1b1d664-6967-4624-b81d-c9af95cae4b0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.094644 Aug 04 02:42:25.564502 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 337/695] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:42:25 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments => generated 371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:25.567435 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:25.580500 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-caf61ed6-465b-4ac4-a42a-ae56347dda33 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.278987 Aug 04 02:42:25.581213 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 359/696] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:25 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:25.725044 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-dd64a484-05fb-4bb2-81fe-0d519de017a0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:25.725536 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-dd64a484-05fb-4bb2-81fe-0d519de017a0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:25.732511 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd64a484-05fb-4bb2-81fe-0d519de017a0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.732965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd64a484-05fb-4bb2-81fe-0d519de017a0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.733738 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd64a484-05fb-4bb2-81fe-0d519de017a0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.734177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-dd64a484-05fb-4bb2-81fe-0d519de017a0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.763898 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-dd64a484-05fb-4bb2-81fe-0d519de017a0 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/b5ddcc55-810d-4a5e-ba8b-052e07b23da3" status: 200 len: 194 microversion: 2.1 time: 0.042701 Aug 04 02:42:25.764509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 338/697] 10.222.0.60 () {58 vars in 1413 bytes} [Thu Aug 4 02:42:25 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/b5ddcc55-810d-4a5e-ba8b-052e07b23da3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:25.775247 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:25.775744 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:25.782309 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.782798 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.783564 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.784001 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.871644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lazy-loading 'services' on Instance uuid fec4ee6a-83ae-412a-869e-6f2ef0d33553 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:42:25.901632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:25.902550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:25.908840 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.909280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:25.910043 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:25.910470 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:26.087598 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:26.095613 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d565764e-00cf-4ac1-a25f-dd2b2c0f9bd8 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.198432 Aug 04 02:42:26.096294 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 339/698] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:25 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:26.105537 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0c7d803f-e84e-4747-a062-33a5e1db9b10 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/b5ddcc55-810d-4a5e-ba8b-052e07b23da3" status: 202 len: 0 microversion: 2.1 time: 0.334629 Aug 04 02:42:26.106122 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 360/699] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:42:25 2022] DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/b5ddcc55-810d-4a5e-ba8b-052e07b23da3 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:42:26.116973 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:26.118160 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:26.124607 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:26.125064 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:26.125993 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:26.126395 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:26.251856 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:26.378514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:26.388213 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:26.390193 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:26.391812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-57919597-e824-48a8-87ba-efbf1f622ec1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.278740 Aug 04 02:42:26.392522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 340/700] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:26 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:26.606442 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:26.607641 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:26.615514 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:26.616246 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:26.617098 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:26.617613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:26.776202 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:26.785002 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1e4d2380-a518-47be-b298-b2538775c09a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.185255 Aug 04 02:42:26.785861 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 361/701] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:26 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:27.118242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:27.118984 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:27.126269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:27.126754 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:27.127533 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:27.127975 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:27.302991 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:27.314249 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8e76c918-ba36-4d29-bf9f-e78142fdafa3 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.200394 Aug 04 02:42:27.315311 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 341/702] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:27 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:27.449960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:27.449960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:27.449960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:27.449960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:27.450865 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:27.450865 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:27.602590 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:27.611348 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:27.613647 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:27.615385 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9a260f9b-77e9-4f1a-b25f-5e597bb2ca73 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.201632 Aug 04 02:42:27.633754 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 362/703] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:27 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:27.811893 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:27.812431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:27.819723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:27.820981 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:27.821930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:27.822565 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:27.996885 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:28.005426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-5e9a4285-c9de-4ae4-bce0-8426ee893426 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.197922 Aug 04 02:42:28.006248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 342/704] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:27 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:28.337544 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:28.338692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:28.345697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:28.346480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:28.347510 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:28.348310 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:28.487101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:28.495890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-741276c5-604f-4043-9d69-2068318d6d1b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.162243 Aug 04 02:42:28.496702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 363/705] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:28 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:28.643381 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:28.643995 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:28.651590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:28.652093 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:28.652851 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:28.653521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:28.826695 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:28.838382 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:28.842016 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:28.842166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e2d0dfcf-267c-41b0-823c-fec01bc8270c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.203967 Aug 04 02:42:28.855547 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 343/706] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:28 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:29.028687 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:29.029437 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:29.036289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:29.036289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:29.037052 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:29.037340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:29.208879 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:29.220476 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7a63730d-baad-4ff8-ba29-c048106fec4c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.195974 Aug 04 02:42:29.221324 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 364/707] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:29 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:29.517374 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:29.518330 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:29.525297 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:29.525750 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:29.526562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:29.527007 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:29.668306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:29.676321 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e7da3398-c51e-4457-81d8-77e0df44df7b tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.162749 Aug 04 02:42:29.676820 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 344/708] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:29 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:29.867957 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:29.868792 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:29.876139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:29.876604 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:29.877561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:29.878139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:30.018474 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:30.028079 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:30.029885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:30.031100 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ad3f0048-d3e4-4d53-a80b-ea116aecbea7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.167862 Aug 04 02:42:30.031667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 365/709] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:29 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:30.244474 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:30.245039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:30.252129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:30.252755 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:30.253603 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:30.254056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:30.456322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:30.464820 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1ab5f4a0-17ba-46ea-9f38-389b3b244889 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.225500 Aug 04 02:42:30.465555 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 345/710] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:30 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:30.699053 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:30.699749 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:30.706855 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:30.707407 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:30.709212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:30.709677 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:30.857425 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:30.865175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-71fbae1c-0b69-4329-a905-9d04b794191e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.171422 Aug 04 02:42:30.865932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 366/711] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:30 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:31.053890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:31.055531 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:31.062166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:31.062675 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:31.063496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:31.063938 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:31.209308 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:31.217845 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:31.219411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:31.220586 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b5bcffbd-0587-4417-a276-2d34a645e724 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.170660 Aug 04 02:42:31.221163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 346/712] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:31 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:31.494790 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:31.495386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:31.502018 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:31.502459 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:31.503280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:31.503719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:31.664385 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:31.675404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3dae804a-c1bf-4cde-9bb2-0d0002986ef5 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.184485 Aug 04 02:42:31.677032 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 367/713] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:31 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:31.900512 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:31.901109 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:31.907667 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:31.908107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:31.908877 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:31.909314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:32.056753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:32.065965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9bb1dee5-a972-4b9d-9920-86257029638a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.170379 Aug 04 02:42:32.078797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 347/714] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:31 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:32.244531 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:32.245276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:32.251562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:32.252017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:32.252795 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:32.253230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:32.391024 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:32.395158 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:32.400425 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:32.402012 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:32.403648 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-d8b375b6-27f9-418e-9700-17051cc86acd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.162836 Aug 04 02:42:32.404215 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 368/715] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:32 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:32.698313 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:32.699052 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:32.705319 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:32.705761 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:32.706575 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:32.708548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:32.851108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:32.859978 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f1106931-3ccd-4828-b738-381a8643ad04 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.166295 Aug 04 02:42:32.860554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 348/716] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:32 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:33.089526 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:33.090173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:33.097438 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:33.102261 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:33.102261 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:33.102261 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:33.234131 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:33.241638 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-34f966a2-ff5c-4fe8-b873-0dc8d05e55e2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.156379 Aug 04 02:42:33.252011 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 369/717] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:33 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:33.426580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:33.427189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:33.433492 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:33.433933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:33.434719 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:33.435151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:33.566640 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:33.575258 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:33.576808 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:33.577974 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-991ac06c-97da-441c-96f3-6aacfb6b8898 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.155306 Aug 04 02:42:33.578550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 349/718] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:33 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:42:33.884102 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:33.884705 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:33.890667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:33.891111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:33.891858 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:33.892286 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:34.040449 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:34.048712 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-faacb26a-4d63-4b42-8a3d-7e3fcbbf141e tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1757 microversion: 2.1 time: 0.169130 Aug 04 02:42:34.049296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 370/719] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:33 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:34.262008 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:34.262651 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:34.268639 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:34.269087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:34.269846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:34.270278 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:34.402932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:34.410736 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-19f9ade2-04b9-4bcf-b7e5-784bd8571ee2 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.152575 Aug 04 02:42:34.411299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 350/720] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:34 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:34.602100 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:34.602864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:34.609659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:34.610192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:34.611114 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:34.611624 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:34.746107 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:34.754030 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:34.760195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:34.760195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-90c912bd-0f96-4938-883e-9a2353a77a9e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.159320 Aug 04 02:42:34.760195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 371/721] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:34 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:35.071024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:35.071712 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:35.078171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.078652 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.079408 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.079834 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.227642 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:35.236413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-05818b38-d6bb-4d2e-afd0-7697fdc49c9a tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1760 microversion: 2.1 time: 0.169725 Aug 04 02:42:35.237083 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 351/722] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:35 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:35.436158 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:35.436158 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:35.439201 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.439718 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.440452 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.440890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.575687 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:35.583110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5b3de080-6a96-4ef9-9899-ae7ede304616 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1576 microversion: 2.1 time: 0.154997 Aug 04 02:42:35.583673 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 372/723] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:35 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:35.752015 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ae64e20e-510b-41c7-a225-c86da8e0886c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:35.756971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ae64e20e-510b-41c7-a225-c86da8e0886c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:35.758727 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae64e20e-510b-41c7-a225-c86da8e0886c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.759180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae64e20e-510b-41c7-a225-c86da8e0886c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.760046 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae64e20e-510b-41c7-a225-c86da8e0886c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.760481 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ae64e20e-510b-41c7-a225-c86da8e0886c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.781375 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:35.782713 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:35.790849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.791577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.792527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.792652 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ae64e20e-510b-41c7-a225-c86da8e0886c tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/8fff87cc-074b-4a66-bed2-078a0d251ff0" status: 200 len: 194 microversion: 2.1 time: 0.044728 Aug 04 02:42:35.793229 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 352/724] 10.222.0.60 () {58 vars in 1413 bytes} [Thu Aug 4 02:42:35 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/8fff87cc-074b-4a66-bed2-078a0d251ff0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:35.793360 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.805341 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:35.805838 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:35.812165 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.812624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.813404 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:35.813872 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:35.897413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lazy-loading 'services' on Instance uuid fec4ee6a-83ae-412a-869e-6f2ef0d33553 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:42:35.932738 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:35.940891 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:35.942403 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:35.943623 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6f8b1741-115b-41c7-9ea1-9ce9b6ed2b62 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.166947 Aug 04 02:42:35.944366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 373/725] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:35 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:42:36.132251 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b2c82557-b336-4829-8012-7407b56b6e9d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/8fff87cc-074b-4a66-bed2-078a0d251ff0" status: 202 len: 0 microversion: 2.1 time: 0.331559 Aug 04 02:42:36.133417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 353/726] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:42:35 2022] DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments/8fff87cc-074b-4a66-bed2-078a0d251ff0 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:42:36.604474 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:36.605093 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:36.611029 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:36.611483 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:36.612241 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:36.612680 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:36.745725 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:36.753323 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-92014147-1fb7-4edd-8a28-2010fa20c577 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1563 microversion: 2.1 time: 0.153319 Aug 04 02:42:36.753890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 374/727] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:36 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:36.968185 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:36.968812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:36.975205 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:36.975660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:36.977039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:36.977477 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:37.108338 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:37.116575 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:37.118270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:37.119454 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-393f24fd-cd6b-4bca-9c06-bda8f39d621e tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.155629 Aug 04 02:42:37.120022 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 354/728] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:36 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:42:37.366023 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-3accf43c-43f6-4033-9d19-fe00b8cba2f8 req-24820227-364e-4d1b-829b-8a7297b40948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa07bb4-3207-4fba-bb58-46ba0452ca16", "name": "network-vif-plugged", "status": "completed", "tag": "9e4ea6f4-5972-44dc-a2ca-c3771cc56a76"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:37.377576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-3accf43c-43f6-4033-9d19-fe00b8cba2f8 req-24820227-364e-4d1b-829b-8a7297b40948 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:37.377576 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-3accf43c-43f6-4033-9d19-fe00b8cba2f8 req-24820227-364e-4d1b-829b-8a7297b40948 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:37.388946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-3accf43c-43f6-4033-9d19-fe00b8cba2f8 req-24820227-364e-4d1b-829b-8a7297b40948 service nova] Creating event network-vif-plugged:9e4ea6f4-5972-44dc-a2ca-c3771cc56a76 for instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 on hv-cinder-74014 Aug 04 02:42:37.394303 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-3accf43c-43f6-4033-9d19-fe00b8cba2f8 req-24820227-364e-4d1b-829b-8a7297b40948 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031821 Aug 04 02:42:37.395185 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 375/729] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:42:38.143267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:38.143880 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:38.150985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.151432 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.152196 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.152632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.281011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:38.288897 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:38.290521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:38.291704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3184069b-a8d3-4028-a0ae-93a56c02a6fa tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.152364 Aug 04 02:42:38.292532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 355/730] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:38 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:38.363252 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1b762dbb-3b9f-4b21-b96e-69d7dcaaa13e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:38.365518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1b762dbb-3b9f-4b21-b96e-69d7dcaaa13e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:38.372305 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b762dbb-3b9f-4b21-b96e-69d7dcaaa13e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.372857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b762dbb-3b9f-4b21-b96e-69d7dcaaa13e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.373497 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b762dbb-3b9f-4b21-b96e-69d7dcaaa13e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.373936 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1b762dbb-3b9f-4b21-b96e-69d7dcaaa13e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.402793 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1b762dbb-3b9f-4b21-b96e-69d7dcaaa13e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043876 Aug 04 02:42:38.403603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 376/731] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:42:38 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:42:38.519734 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-20a5852e-4a16-40ed-804f-2520f2ce4f31 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:38.521970 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-20a5852e-4a16-40ed-804f-2520f2ce4f31 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:38.523952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=90 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:38.528932 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a5852e-4a16-40ed-804f-2520f2ce4f31 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.529440 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a5852e-4a16-40ed-804f-2520f2ce4f31 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.530208 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a5852e-4a16-40ed-804f-2520f2ce4f31 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.530685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a5852e-4a16-40ed-804f-2520f2ce4f31 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.545700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:38.563242 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-20a5852e-4a16-40ed-804f-2520f2ce4f31 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047465 Aug 04 02:42:38.564037 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 356/732] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:42:38 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:42:38.631329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:38.631823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:38.638429 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.638912 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.639733 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.640169 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.666684 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:42:38.829296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:38.922149 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-90ae178d-ba22-49c0-b0d9-19b0e089595e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 204 len: 0 microversion: 2.1 time: 0.294311 Aug 04 02:42:38.922785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 377/733] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:42:38 2022] DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:42:38.938243 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:38.938243 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:38.939122 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.939579 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:38.940360 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:38.940797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:39.075692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:39.083751 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a95b909c-e7a1-44c8-9bb7-eeb49440fbac tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1672 microversion: 2.1 time: 0.156379 Aug 04 02:42:39.084613 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 357/734] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:38 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:39.315376 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:39.316192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:39.322852 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:39.323354 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:39.324074 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:39.324513 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:39.458998 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:39.467579 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:39.469085 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:39.470242 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6618904f-70ee-4238-bdda-4825e8d58b3b tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.159541 Aug 04 02:42:39.470834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 378/735] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:39 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:40.111627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:40.112262 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:40.119772 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:40.120215 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:40.121014 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:40.121440 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:40.251754 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:40.259808 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-19288288-36db-43fd-a7bf-cae85a36870f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1672 microversion: 2.1 time: 0.152204 Aug 04 02:42:40.260370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 358/736] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:40 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:40.494206 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:40.494849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:40.501335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:40.501779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:40.502572 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:40.503007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:40.630801 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:40.639376 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:40.640892 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:40.642042 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-dba29e32-b561-4b39-81fa-1fb3618fa9a2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1733 microversion: 2.20 time: 0.151945 Aug 04 02:42:40.642638 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 379/737] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:40 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:41.280749 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:41.281358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:41.287649 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:41.289770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:41.289770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:41.289770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:41.533196 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:41.541735 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-25e4676e-0e27-4dda-a92b-f67bda4c608e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1672 microversion: 2.1 time: 0.264983 Aug 04 02:42:41.542316 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 359/738] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:41 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:42:41.666043 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:41.666788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:41.673231 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:41.673676 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:41.674444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:41.674896 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:41.808004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:41.816065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:41.817587 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:41.818761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2f823b37-8515-4c8d-8442-e24c3ecacb22 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1720 microversion: 2.20 time: 0.157473 Aug 04 02:42:41.819327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 380/739] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:42:41 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:42:42.547845 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-5ec2e914-f5b4-4013-9fea-3cb792993646 req-02693695-2b37-4d88-b0d8-aba80755e55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec4ee6a-83ae-412a-869e-6f2ef0d33553", "name": "network-vif-deleted", "tag": "2633d7b8-bde0-4b89-ad15-c794d1a1ed93"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:42:42.558414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5ec2e914-f5b4-4013-9fea-3cb792993646 req-02693695-2b37-4d88-b0d8-aba80755e55a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:42.558907 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-5ec2e914-f5b4-4013-9fea-3cb792993646 req-02693695-2b37-4d88-b0d8-aba80755e55a service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:42.564063 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:42.564864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:42.570477 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-5ec2e914-f5b4-4013-9fea-3cb792993646 req-02693695-2b37-4d88-b0d8-aba80755e55a service nova] Creating event network-vif-deleted:2633d7b8-bde0-4b89-ad15-c794d1a1ed93 for instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 on hv-cinder-74014 Aug 04 02:42:42.571234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:42.571535 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:42.573034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:42.573484 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:42.575971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-5ec2e914-f5b4-4013-9fea-3cb792993646 req-02693695-2b37-4d88-b0d8-aba80755e55a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094809 Aug 04 02:42:42.577123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 360/740] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:42:42.638863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99068d55e19e4b3cbf9197ca46d86fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c4c2e98c444c07b2919db3e65cedf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:42:42.646531 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b9f490ee-0d65-45e2-af68-0f33b4e1e6d5 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 200 len: 1605 microversion: 2.1 time: 0.087087 Aug 04 02:42:42.647330 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 381/741] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:42 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:42:43.669438 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:43.672744 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:43.676576 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:43.677029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:43.677822 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:43.678260 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:43.691878 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] HTTP exception thrown: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Request method failure captured: Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 HTTP/1.1 Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zC-choGaHQNSVeP5lvsf-TMOx0pgTZfwugizbiDis9YLvS9LWr2lUdXa7QUSGMMMxhvZl1pZEWmAhpMGm_RIvJPnVn6MQIEUwwK7Vqb2hbbXCEgsK7MbTAWodgAtJX6RDskVMF9e8ki37eKoe0TWgjp05L8fvM5hb7PGYboF8-RQNo Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:42:43.693487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 99068d55e19e4b3cbf9197ca46d86fd3 Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:43.695123 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'fec4ee6a-83ae-412a-869e-6f2ef0d33553'} Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:42:43.696039 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:43.697590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:43.698923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Returning 404 to user: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:42:43.698923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e04cb4ff-7019-4922-9a07-a24b058ed33e tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 404 len: 111 microversion: 2.1 time: 0.031026 Aug 04 02:42:43.698923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 361/742] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:43 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:42:43.703732 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7c711246-750f-4a29-9e2f-ab6077c87cf8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '.version_select at 0x7fa64626da60>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:43.785603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7c711246-750f-4a29-9e2f-ab6077c87cf8 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658122665" status: 202 len: 0 microversion: 2.1 time: 0.085589 Aug 04 02:42:43.786209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 382/743] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 4 02:42:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658122665 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:42:47.112312 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:47.112788 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:47.119247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:47.119734 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:47.120488 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:47.120912 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:47.134218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] HTTP exception thrown: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Request method failure captured: Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 HTTP/1.1 Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zC-choGaHQNSVeP5lvsf-TMOx0pgTZfwugizbiDis9YLvS9LWr2lUdXa7QUSGMMMxhvZl1pZEWmAhpMGm_RIvJPnVn6MQIEUwwK7Vqb2hbbXCEgsK7MbTAWodgAtJX6RDskVMF9e8ki37eKoe0TWgjp05L8fvM5hb7PGYboF8-RQNo Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:42:47.136299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 99068d55e19e4b3cbf9197ca46d86fd3 Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.137842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'fec4ee6a-83ae-412a-869e-6f2ef0d33553'} Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:42:47.138709 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.139906 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.141081 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Returning 404 to user: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:42:47.141081 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d9ef2f44-759c-4dbf-9194-48273e78b387 tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 404 len: 111 microversion: 2.1 time: 0.029177 Aug 04 02:42:47.141081 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 362/744] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:42:47 2022] DELETE /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:42:47.146400 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:47.147038 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: fec4ee6a-83ae-412a-869e-6f2ef0d33553] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:47.154146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:47.154619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:47.155369 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:47.155797 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:47.169209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] HTTP exception thrown: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Request method failure captured: Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 HTTP/1.1 Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zC-choGaHQNSVeP5lvsf-TMOx0pgTZfwugizbiDis9YLvS9LWr2lUdXa7QUSGMMMxhvZl1pZEWmAhpMGm_RIvJPnVn6MQIEUwwK7Vqb2hbbXCEgsK7MbTAWodgAtJX6RDskVMF9e8ki37eKoe0TWgjp05L8fvM5hb7PGYboF8-RQNo Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:42:47.170863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 99068d55e19e4b3cbf9197ca46d86fd3 Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.172463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': 'fec4ee6a-83ae-412a-869e-6f2ef0d33553'} Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:42:47.173422 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. Aug 04 02:42:47.174868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:47.176280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Returning 404 to user: Instance fec4ee6a-83ae-412a-869e-6f2ef0d33553 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:42:47.176280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-601202ba-1a00-4682-917d-2a5c95af167d tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553" status: 404 len: 111 microversion: 2.1 time: 0.030167 Aug 04 02:42:47.176280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 383/745] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:47 2022] GET /compute/v2.1/servers/fec4ee6a-83ae-412a-869e-6f2ef0d33553 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:42:48.403449 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:48.403951 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:48.410869 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:48.411320 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:48.412082 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:48.412518 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:48.426247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] HTTP exception thrown: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Request method failure captured: Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f HTTP/1.1 Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zC-choGaHQNSVeP5lvsf-TMOx0pgTZfwugizbiDis9YLvS9LWr2lUdXa7QUSGMMMxhvZl1pZEWmAhpMGm_RIvJPnVn6MQIEUwwK7Vqb2hbbXCEgsK7MbTAWodgAtJX6RDskVMF9e8ki37eKoe0TWgjp05L8fvM5hb7PGYboF8-RQNo Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:42:48.427812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 99068d55e19e4b3cbf9197ca46d86fd3 Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.429442 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'ab1c4809-6fd6-4207-b2e0-7b9801de9c0f'} Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:42:48.430314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.431775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.433848 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Returning 404 to user: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:42:48.433848 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-222be1ca-9ae7-4d05-a12b-824322301a6f tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 404 len: 111 microversion: 2.1 time: 0.029972 Aug 04 02:42:48.433848 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 363/746] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:42:48 2022] DELETE /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:42:48.438177 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:42:48.438818 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] [instance: ab1c4809-6fd6-4207-b2e0-7b9801de9c0f] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:42:48.445226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:48.445677 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:48.446440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:42:48.446901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:42:48.460261 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] HTTP exception thrown: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Request method failure captured: Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f HTTP/1.1 Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zC-choGaHQNSVeP5lvsf-TMOx0pgTZfwugizbiDis9YLvS9LWr2lUdXa7QUSGMMMxhvZl1pZEWmAhpMGm_RIvJPnVn6MQIEUwwK7Vqb2hbbXCEgsK7MbTAWodgAtJX6RDskVMF9e8ki37eKoe0TWgjp05L8fvM5hb7PGYboF8-RQNo Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:42:48.461755 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a2c4c2e98c444c07b2919db3e65cedf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: a2c4c2e98c444c07b2919db3e65cedf2 Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1767401090 Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 99068d55e19e4b3cbf9197ca46d86fd3 Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeTestJSON-1767401090-project Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.463204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': 'ab1c4809-6fd6-4207-b2e0-7b9801de9c0f'} Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:42:48.464051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. Aug 04 02:42:48.465549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:42:48.467026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] Returning 404 to user: Instance ab1c4809-6fd6-4207-b2e0-7b9801de9c0f could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:42:48.467026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e153d2e2-bc9e-4af0-a777-0c8431c87cff tempest-AttachVolumeTestJSON-1767401090 tempest-AttachVolumeTestJSON-1767401090-project] 10.222.0.60 "GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f" status: 404 len: 111 microversion: 2.1 time: 0.028907 Aug 04 02:42:48.467026 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 384/747] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:42:48 2022] GET /compute/v2.1/servers/ab1c4809-6fd6-4207-b2e0-7b9801de9c0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:43:11.514930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-124727833"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:11.515479 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:11.517563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=15 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:11.518346 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=29 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:11.523128 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:11.523576 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:11.524467 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:11.524904 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:11.650644 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.network.security_group_api [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Removing security group 225abd4c-e0b0-4f21-922b-c1500294ad81 from port c10bdcd9-3678-4c5c-92d6-0dbad937505d Aug 04 02:43:12.010496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-700cfc61-e9c7-4848-89b5-5ccca3c7717c tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.499611 Aug 04 02:43:12.014916 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 364/748] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 4 02:43:11 2022] POST /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:43:12.026172 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-13d0a2ce-b7b4-4f6c-99ce-a3f195bd519c req-1a2e1c09-1e6b-4b2d-81e4-12465b3e6784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deddf119-039c-4060-a7bd-79554b9c1ba0", "tag": "c10bdcd9-3678-4c5c-92d6-0dbad937505d"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:12.060264 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:12.061260 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:12.064013 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-13d0a2ce-b7b4-4f6c-99ce-a3f195bd519c req-1a2e1c09-1e6b-4b2d-81e4-12465b3e6784 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:12.064454 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-13d0a2ce-b7b4-4f6c-99ce-a3f195bd519c req-1a2e1c09-1e6b-4b2d-81e4-12465b3e6784 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:12.090692 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-13d0a2ce-b7b4-4f6c-99ce-a3f195bd519c req-1a2e1c09-1e6b-4b2d-81e4-12465b3e6784 service nova] Creating event network-changed:c10bdcd9-3678-4c5c-92d6-0dbad937505d for instance deddf119-039c-4060-a7bd-79554b9c1ba0 on hv-cinder-74014 Aug 04 02:43:12.096790 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-13d0a2ce-b7b4-4f6c-99ce-a3f195bd519c req-1a2e1c09-1e6b-4b2d-81e4-12465b3e6784 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079580 Aug 04 02:43:12.105175 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 385/749] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:13.565306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:13.565936 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:13.572846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:13.573376 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:13.574214 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:13.574775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:13.661519 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lazy-loading 'services' on Instance uuid deddf119-039c-4060-a7bd-79554b9c1ba0 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:43:13.859299 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-770ae71d-a7e5-465d-a48f-37ec502b7fbd tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "DELETE /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments/548d9cf6-2b3b-4bba-bb37-dcc5a76432c8" status: 202 len: 0 microversion: 2.1 time: 0.298720 Aug 04 02:43:13.859902 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 365/750] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:43:13 2022] DELETE /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments/548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:43:13.870827 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fb8f9677-139f-4871-b0e9-87ac2a210864 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:13.873756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fb8f9677-139f-4871-b0e9-87ac2a210864 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:13.882225 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb8f9677-139f-4871-b0e9-87ac2a210864 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:13.882778 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb8f9677-139f-4871-b0e9-87ac2a210864 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:13.883567 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb8f9677-139f-4871-b0e9-87ac2a210864 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:13.884006 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb8f9677-139f-4871-b0e9-87ac2a210864 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:13.916421 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fb8f9677-139f-4871-b0e9-87ac2a210864 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051525 Aug 04 02:43:13.916921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 386/751] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:43:13 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:14.113746 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-db63f684-30ac-4788-b6ad-3be65e910c05 req-b021c0e0-0c77-41b6-8ec0-ae1f58174c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deddf119-039c-4060-a7bd-79554b9c1ba0", "tag": "c10bdcd9-3678-4c5c-92d6-0dbad937505d"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:14.124568 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-db63f684-30ac-4788-b6ad-3be65e910c05 req-b021c0e0-0c77-41b6-8ec0-ae1f58174c40 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:14.127867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-db63f684-30ac-4788-b6ad-3be65e910c05 req-b021c0e0-0c77-41b6-8ec0-ae1f58174c40 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:14.137435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-db63f684-30ac-4788-b6ad-3be65e910c05 req-b021c0e0-0c77-41b6-8ec0-ae1f58174c40 service nova] Creating event network-changed:c10bdcd9-3678-4c5c-92d6-0dbad937505d for instance deddf119-039c-4060-a7bd-79554b9c1ba0 on hv-cinder-74014 Aug 04 02:43:14.142430 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-db63f684-30ac-4788-b6ad-3be65e910c05 req-b021c0e0-0c77-41b6-8ec0-ae1f58174c40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033051 Aug 04 02:43:14.143066 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 366/752] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:14.933011 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c1e90770-d439-4620-8250-eeddecb7de61 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:14.935938 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c1e90770-d439-4620-8250-eeddecb7de61 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:14.944086 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1e90770-d439-4620-8250-eeddecb7de61 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:14.944544 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1e90770-d439-4620-8250-eeddecb7de61 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:14.945325 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1e90770-d439-4620-8250-eeddecb7de61 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:14.945769 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1e90770-d439-4620-8250-eeddecb7de61 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:14.974956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c1e90770-d439-4620-8250-eeddecb7de61 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049437 Aug 04 02:43:14.975520 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 387/753] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:43:14 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:43:14.988487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:14.989084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:14.995480 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:14.995885 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:14.996683 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:14.997119 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:15.053466 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f5cb0225-f30f-4d0c-a6ac-f4f1d649713f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:15.057919 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f5cb0225-f30f-4d0c-a6ac-f4f1d649713f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:15.062814 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f5cb0225-f30f-4d0c-a6ac-f4f1d649713f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:15.063270 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f5cb0225-f30f-4d0c-a6ac-f4f1d649713f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:15.064042 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f5cb0225-f30f-4d0c-a6ac-f4f1d649713f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:15.064489 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f5cb0225-f30f-4d0c-a6ac-f4f1d649713f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:15.083435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] HTTP exception thrown: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 is not attached to volume 548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 Aug 04 02:43:15.095008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f5cb0225-f30f-4d0c-a6ac-f4f1d649713f tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045504 Aug 04 02:43:15.095590 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 388/754] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 4 02:43:15 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Request method failure captured: Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments/548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 HTTP/1.1 Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zGpy_tTgRUYgCUhqzZ1D4OH3iw8lGR1US2W7gCcFXsNbwIg5lF0qVqcTjIzEvKTEbrUebOxevh56eMej0P86NxjlI9kiNl5hMWd0d_777uITMUiTVgUHphJ5t9yKro23lF4djwLBop2dmAiFr6Pwwn7Oko7Qo177ynEWk7Fsp-xWBw Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: b14b11a92ccb494ea480962861bac477 Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-TestMinimumBasicScenario-1652301292 Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:43:15.107585 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b14b11a92ccb494ea480962861bac477"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b14b11a92ccb494ea480962861bac477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b14b11a92ccb494ea480962861bac477"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b14b11a92ccb494ea480962861bac477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-TestMinimumBasicScenario-1652301292 Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: b14b11a92ccb494ea480962861bac477 Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1652301292 Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-TestMinimumBasicScenario-1652301292-project Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 8a7246f0c1f44d968ca839d36ecae75e Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-TestMinimumBasicScenario-1652301292-project Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:43:15.109226 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 is not attached to volume 548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'server_id': 'deddf119-039c-4060-a7bd-79554b9c1ba0', 'id': '548d9cf6-2b3b-4bba-bb37-dcc5a76432c8'} Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 548d9cf6-2b3b-4bba-bb37-dcc5a76432c8. Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:43:15.110269 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 is not attached to volume 548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 is not attached to volume 548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:15.111780 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Returning 404 to user: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 is not attached to volume 548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:43:15.112904 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-097cad50-621c-4925-9199-d84993e214e7 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "DELETE /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments/548d9cf6-2b3b-4bba-bb37-dcc5a76432c8" status: 404 len: 154 microversion: 2.1 time: 0.121692 Aug 04 02:43:15.112904 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 367/755] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:43:14 2022] DELETE /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0/os-volume_attachments/548d9cf6-2b3b-4bba-bb37-dcc5a76432c8 => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:43:15.163171 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:15.163660 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:15.170088 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:15.170559 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:15.171326 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:15.171740 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:15.196935 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:43:15.482288 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f842af3c-2a07-40f2-82a7-bab9b577391c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 204 len: 0 microversion: 2.20 time: 0.322534 Aug 04 02:43:15.482985 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 389/756] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 4 02:43:15 2022] DELETE /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 02:43:15.492134 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:15.492899 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:15.499483 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:15.499997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:15.500752 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:15.501356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:15.633093 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:15.641807 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:15.643356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:15.644517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fb445447-3619-4430-a736-635a32d605c7 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.157077 Aug 04 02:43:15.645071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 368/757] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:15 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:43:16.431969 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:16.432547 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:16.439044 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:16.442020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:16.442020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:16.442020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:16.465931 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:43:16.667344 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:16.668011 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:16.674941 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:16.675452 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:16.676165 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:16.676601 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:16.810507 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:16.818710 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:16.820228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:16.821385 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-5841e246-cfe3-4a10-b42c-2d9db1e76170 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.157959 Aug 04 02:43:16.821950 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 369/758] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:16 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:43:16.826136 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8f74387c-3372-4dee-bbd5-b2c796196f49 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "DELETE /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 204 len: 0 microversion: 2.1 time: 0.397483 Aug 04 02:43:16.833785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 390/759] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:43:16 2022] DELETE /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:43:16.834711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:16.835284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:16.842130 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:16.842851 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:16.843624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:16.844065 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:16.973565 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:16.981250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bcc2f06d-dca4-480a-a9a0-d57b5f1f4919 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1555 microversion: 2.1 time: 0.150433 Aug 04 02:43:16.981829 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 370/760] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:16 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:17.846144 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:17.846876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:17.853362 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:17.853811 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:17.854596 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:17.855034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:17.985888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:17.993903 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:17.995451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:17.996717 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5a77cf57-76fe-499a-87b9-f27f80622db4 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.155827 Aug 04 02:43:17.997312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 391/761] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:17 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:43:18.003727 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:18.004369 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:18.010910 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:18.011385 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:18.012171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:18.012602 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:18.144483 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:18.152349 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1f5d46ea-9cdb-427e-a4ee-d57dcab04763 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1555 microversion: 2.1 time: 0.152663 Aug 04 02:43:18.153215 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 371/762] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:17 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:19.019873 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:19.020646 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:19.028365 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:19.029034 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:19.029985 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:19.031121 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:19.174768 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:19.175974 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:19.183182 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:19.183641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:19.184414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:19.184845 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:19.195055 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:19.204771 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:19.206540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:19.207719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4ed63e70-fee3-45cc-a447-219dacbafe1c tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1726 microversion: 2.20 time: 0.191865 Aug 04 02:43:19.208283 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 392/763] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:19 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1726 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:43:19.443664 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:19.453228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-454e114f-8f91-42c0-82af-c1c3bc3d040d tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1555 microversion: 2.1 time: 0.282494 Aug 04 02:43:19.453997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 372/764] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:19 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1555 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:43:19.744662 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-58f42c46-6058-43be-8415-b2144de72bd2 req-633291a7-5137-428c-b43d-c7e245da9389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deddf119-039c-4060-a7bd-79554b9c1ba0", "name": "network-vif-deleted", "tag": "c10bdcd9-3678-4c5c-92d6-0dbad937505d"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:19.754933 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-58f42c46-6058-43be-8415-b2144de72bd2 req-633291a7-5137-428c-b43d-c7e245da9389 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:19.755515 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-58f42c46-6058-43be-8415-b2144de72bd2 req-633291a7-5137-428c-b43d-c7e245da9389 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:19.767584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-58f42c46-6058-43be-8415-b2144de72bd2 req-633291a7-5137-428c-b43d-c7e245da9389 service nova] Creating event network-vif-deleted:c10bdcd9-3678-4c5c-92d6-0dbad937505d for instance deddf119-039c-4060-a7bd-79554b9c1ba0 on hv-cinder-74014 Aug 04 02:43:19.772583 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-58f42c46-6058-43be-8415-b2144de72bd2 req-633291a7-5137-428c-b43d-c7e245da9389 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031751 Aug 04 02:43:19.773189 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 393/765] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:43:20.233650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:20.234282 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:20.241270 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:20.241715 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:20.244539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:20.244539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:20.305219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:20.314719 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:20.316237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64be537a50754c838554d1a2e0a4177a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c45c4b6ccc40e3bdf304d9141d56ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:20.317402 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1dff6eb6-707b-49ba-bf45-5973bada3957 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 200 len: 1658 microversion: 2.20 time: 0.088592 Aug 04 02:43:20.319046 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 373/766] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:20 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 1658 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:43:20.475421 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:20.476181 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:20.486546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:20.490751 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:20.493343 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:20.494927 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:20.532209 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:20.532665 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:20.533127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lazy-loading 'fault' on Instance uuid deddf119-039c-4060-a7bd-79554b9c1ba0 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:43:20.585432 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7246f0c1f44d968ca839d36ecae75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b11a92ccb494ea480962861bac477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:20.593879 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-b2d3b7c8-c3d7-49a5-b16c-fc5c5d2af633 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 200 len: 1349 microversion: 2.1 time: 0.122972 Aug 04 02:43:20.594838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 394/767] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:20 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 1349 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:21.340568 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:21.341677 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:21.348222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:21.348674 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:21.349449 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:21.349887 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:21.364016 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] HTTP exception thrown: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Request method failure captured: Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 HTTP/1.1 Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDAWEdhYHez8LxaGO7monQkTpsUVQNM5FRaeoM69rLEFtF4mSaiD2Dgnpki1ebYdtiFb0vizWpWHiThkEjvmByW1H9KCROSTflqJcjhbGw-uJY7xMI6x9_6cVvjOWab9rfRN8ptyQwDacC8d0YBgu2lYcTBUY102Zo12cRVv36RAtQ Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:43:21.365562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 64be537a50754c838554d1a2e0a4177a Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:21.367184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'ffa07bb4-3207-4fba-bb58-46ba0452ca16'} Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:43:21.371359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:21.372846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.374155 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Returning 404 to user: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:43:21.374155 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-da48b534-142d-4032-a975-48969e53d0d1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 404 len: 111 microversion: 2.20 time: 0.030384 Aug 04 02:43:21.374155 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 374/768] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:21 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:43:21.376574 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1ac00c3f-72b1-4368-872b-72ac466234b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '.version_select at 0x7fa6460321f0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:21.443115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1ac00c3f-72b1-4368-872b-72ac466234b2 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131971570" status: 204 len: 0 microversion: 2.20 time: 0.071030 Aug 04 02:43:21.443707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 395/769] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 4 02:43:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131971570 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 02:43:21.615958 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:21.616537 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] [instance: deddf119-039c-4060-a7bd-79554b9c1ba0] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:21.623275 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:21.623731 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:21.624517 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:21.624950 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:21.640618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] HTTP exception thrown: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 could not be found. Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Request method failure captured: Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 HTTP/1.1 Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zGpy_tTgRUYgCUhqzZ1D4OH3iw8lGR1US2W7gCcFXsNbwIg5lF0qVqcTjIzEvKTEbrUebOxevh56eMej0P86NxjlI9kiNl5hMWd0d_777uITMUiTVgUHphJ5t9yKro23lF4djwLBop2dmAiFr6Pwwn7Oko7Qo177ynEWk7Fsp-xWBw Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: b14b11a92ccb494ea480962861bac477 Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-TestMinimumBasicScenario-1652301292 Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:43:21.642545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b14b11a92ccb494ea480962861bac477"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b14b11a92ccb494ea480962861bac477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b14b11a92ccb494ea480962861bac477"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b14b11a92ccb494ea480962861bac477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-TestMinimumBasicScenario-1652301292 Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: b14b11a92ccb494ea480962861bac477 Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1652301292 Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-TestMinimumBasicScenario-1652301292-project Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 8a7246f0c1f44d968ca839d36ecae75e Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-TestMinimumBasicScenario-1652301292-project Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 could not be found. Aug 04 02:43:21.644095 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'deddf119-039c-4060-a7bd-79554b9c1ba0'} Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 could not be found. Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:43:21.644890 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 could not be found. Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 could not be found. Aug 04 02:43:21.646153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:21.649056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Returning 404 to user: Instance deddf119-039c-4060-a7bd-79554b9c1ba0 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:43:21.649056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9a0e1abf-8973-4421-b136-3702bce6e4da tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0" status: 404 len: 111 microversion: 2.1 time: 0.032187 Aug 04 02:43:21.649056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 375/770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:21 2022] GET /compute/v2.1/servers/deddf119-039c-4060-a7bd-79554b9c1ba0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:43:21.655033 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5ba2291b-cb7b-4000-9ee5-63a3df580685 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] Calling method '.version_select at 0x7fa6460a20d0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:21.774785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5ba2291b-cb7b-4000-9ee5-63a3df580685 tempest-TestMinimumBasicScenario-1652301292 tempest-TestMinimumBasicScenario-1652301292-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1617273470" status: 202 len: 0 microversion: 2.1 time: 0.125539 Aug 04 02:43:21.775406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 396/771] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 4 02:43:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1617273470 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:43:22.083819 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-63f874ba-f7fa-45a3-8a36-9be235e5fb94 req-ff5f5506-ada5-46a0-9aac-2216e7da00d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa07bb4-3207-4fba-bb58-46ba0452ca16", "name": "network-vif-deleted", "tag": "9e4ea6f4-5972-44dc-a2ca-c3771cc56a76"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:22.093782 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-63f874ba-f7fa-45a3-8a36-9be235e5fb94 req-ff5f5506-ada5-46a0-9aac-2216e7da00d5 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:22.094217 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-63f874ba-f7fa-45a3-8a36-9be235e5fb94 req-ff5f5506-ada5-46a0-9aac-2216e7da00d5 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:22.104867 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-63f874ba-f7fa-45a3-8a36-9be235e5fb94 req-ff5f5506-ada5-46a0-9aac-2216e7da00d5 service nova] Creating event network-vif-deleted:9e4ea6f4-5972-44dc-a2ca-c3771cc56a76 for instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 on hv-cinder-74014 Aug 04 02:43:22.110047 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-63f874ba-f7fa-45a3-8a36-9be235e5fb94 req-ff5f5506-ada5-46a0-9aac-2216e7da00d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029868 Aug 04 02:43:22.110669 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 376/772] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:23.554315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:23.554833 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:23.562042 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:23.562639 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:23.563632 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:23.564146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:23.579698 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] HTTP exception thrown: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Request method failure captured: Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: DELETE /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 HTTP/1.1 Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zDAWEdhYHez8LxaGO7monQkTpsUVQNM5FRaeoM69rLEFtF4mSaiD2Dgnpki1ebYdtiFb0vizWpWHiThkEjvmByW1H9KCROSTflqJcjhbGw-uJY7xMI6x9_6cVvjOWab9rfRN8ptyQwDacC8d0YBgu2lYcTBUY102Zo12cRVv36RAtQ Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:43:23.581396 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 64be537a50754c838554d1a2e0a4177a Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.582953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': 'ffa07bb4-3207-4fba-bb58-46ba0452ca16'} Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:43:23.583750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.584932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.586095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Returning 404 to user: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:43:23.586095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-7569e5a7-cbc5-4552-b997-aead5de115f3 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 404 len: 111 microversion: 2.20 time: 0.033382 Aug 04 02:43:23.586095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 397/773] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 4 02:43:23 2022] DELETE /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:43:23.593600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:23.594510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: ffa07bb4-3207-4fba-bb58-46ba0452ca16] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:23.600815 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:23.601258 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:23.602022 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:23.602451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:23.616512 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] HTTP exception thrown: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Request method failure captured: Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 HTTP/1.1 Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDAWEdhYHez8LxaGO7monQkTpsUVQNM5FRaeoM69rLEFtF4mSaiD2Dgnpki1ebYdtiFb0vizWpWHiThkEjvmByW1H9KCROSTflqJcjhbGw-uJY7xMI6x9_6cVvjOWab9rfRN8ptyQwDacC8d0YBgu2lYcTBUY102Zo12cRVv36RAtQ Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:43:23.618274 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 64be537a50754c838554d1a2e0a4177a Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.619684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'ffa07bb4-3207-4fba-bb58-46ba0452ca16'} Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:43:23.620392 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. Aug 04 02:43:23.621587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:23.623688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Returning 404 to user: Instance ffa07bb4-3207-4fba-bb58-46ba0452ca16 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:43:23.623688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-90f39a8c-2970-4abf-834f-ebef17aa6ac1 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16" status: 404 len: 111 microversion: 2.20 time: 0.031634 Aug 04 02:43:23.623688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 377/774] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:23 2022] GET /compute/v2.1/servers/ffa07bb4-3207-4fba-bb58-46ba0452ca16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:43:24.917237 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:24.917740 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:24.927756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:24.929453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:24.931534 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:24.931924 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:24.948879 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] HTTP exception thrown: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Request method failure captured: Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: DELETE /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 HTTP/1.1 Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zDAWEdhYHez8LxaGO7monQkTpsUVQNM5FRaeoM69rLEFtF4mSaiD2Dgnpki1ebYdtiFb0vizWpWHiThkEjvmByW1H9KCROSTflqJcjhbGw-uJY7xMI6x9_6cVvjOWab9rfRN8ptyQwDacC8d0YBgu2lYcTBUY102Zo12cRVv36RAtQ Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:43:24.950971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 64be537a50754c838554d1a2e0a4177a Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:24.952591 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '88fb61ca-19be-4d4c-a340-ec997691ac10'} Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:43:24.953440 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:24.954885 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:43:24.957352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Returning 404 to user: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:43:24.958366 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fdf300d2-0877-4f2c-8173-90a3e70c12bd tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "DELETE /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 404 len: 111 microversion: 2.20 time: 0.045185 Aug 04 02:43:24.959127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 398/775] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 4 02:43:24 2022] DELETE /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:43:24.968587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:24.970225 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] [instance: 88fb61ca-19be-4d4c-a340-ec997691ac10] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:24.980008 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:24.981405 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:24.983373 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:24.984087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:25.004601 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] HTTP exception thrown: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Request method failure captured: Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 HTTP/1.1 Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zDAWEdhYHez8LxaGO7monQkTpsUVQNM5FRaeoM69rLEFtF4mSaiD2Dgnpki1ebYdtiFb0vizWpWHiThkEjvmByW1H9KCROSTflqJcjhbGw-uJY7xMI6x9_6cVvjOWab9rfRN8ptyQwDacC8d0YBgu2lYcTBUY102Zo12cRVv36RAtQ Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:43:25.006161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c45c4b6ccc40e3bdf304d9141d56ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 16c45c4b6ccc40e3bdf304d9141d56ca Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-320946485 Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 64be537a50754c838554d1a2e0a4177a Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-320946485-project Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:25.011365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '88fb61ca-19be-4d4c-a340-ec997691ac10'} Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:43:25.012178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. Aug 04 02:43:25.013399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:43:25.014460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] Returning 404 to user: Instance 88fb61ca-19be-4d4c-a340-ec997691ac10 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:43:25.014460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7690dac5-7f70-46f8-916a-11496db0e338 tempest-AttachVolumeShelveTestJSON-320946485 tempest-AttachVolumeShelveTestJSON-320946485-project] 10.222.0.60 "GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10" status: 404 len: 111 microversion: 2.20 time: 0.044676 Aug 04 02:43:25.014460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 378/776] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 4 02:43:24 2022] GET /compute/v2.1/servers/88fb61ca-19be-4d4c-a340-ec997691ac10 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:43:37.849312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:37.850054 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:37.983761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-cb34df2e-09aa-4027-a2dd-3db2dc4f3240 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: .version_select at 0x7fa64620e040>, body: {"keypair": {"name": "tempest-keypair-129093981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu5gTT4Tw3X7o23zsJhuiDFS90bQO/JtV7cLjbfkvwUzXAra4TGdrw5GtIQW6z63YxBoYfDIucpSabb4VvXyDmsmAD32EMo8l5zPREy/dDGHMDftC70MsCcMlCq8m+b5Q=="}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:38.000403 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-cb34df2e-09aa-4027-a2dd-3db2dc4f3240 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:43:38.004613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-cb34df2e-09aa-4027-a2dd-3db2dc4f3240 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:43:38.111095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-cb34df2e-09aa-4027-a2dd-3db2dc4f3240 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267213 Aug 04 02:43:38.116861 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 399/777] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:43:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:40.649051 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1532600481", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "504f11d1-22cf-4971-a6d4-d7b56ff2e4da"}], "security_groups": [{"name": "tempest-securitygroup--273902342"}], "key_name": "tempest-keypair-129093981", "user_data": "}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:40.659079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=30 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:40.659777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:40.774310 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] validate_networks() for [('504f11d1-22cf-4971-a6d4-d7b56ff2e4da', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:43:41.295832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:43:41.296252 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:43:41.296720 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:43:41.297146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:43:41.297553 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:43:41.306621 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:41.307065 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:41.307856 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:41.308288 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:41.326329 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:43:41.330351 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:43:41.341405 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:43:41.343755 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:43:41.484150 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a3f46be7-d06d-4537-b61d-cb3ebd9901dd tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.839539 Aug 04 02:43:41.485024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 379/778] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:43:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:43:41.500658 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-598b3b06-7de9-481b-a34c-ca490c75ebc1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:41.501314 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-598b3b06-7de9-481b-a34c-ca490c75ebc1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:41.617162 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-598b3b06-7de9-481b-a34c-ca490c75ebc1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:41.628264 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-598b3b06-7de9-481b-a34c-ca490c75ebc1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1241 microversion: 2.1 time: 0.135828 Aug 04 02:43:41.629166 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 400/779] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:41 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:42.650107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:42.650772 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:42.658945 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:42.659426 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:42.660205 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:42.660647 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:42.724532 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:42.732266 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a5026b48-9b4b-4632-8a9c-bf4d5dce71d1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1245 microversion: 2.1 time: 0.086724 Aug 04 02:43:42.732858 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 380/780] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:42 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:43.753780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:43.754802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:43.761214 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:43.761766 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:43.762770 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:43.763431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:43.836493 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:43.846181 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4a5b4673-9770-4326-9a03-4a011cb4f1f6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1301 microversion: 2.1 time: 0.096211 Aug 04 02:43:43.847721 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 401/781] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:43 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:44.872809 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:44.873395 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:44.880465 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:44.881859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:44.881859 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:44.882313 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:45.073786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:45.085502 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a3e6ef67-52ef-40ce-a4a2-603704f3cedf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1366 microversion: 2.1 time: 0.217342 Aug 04 02:43:45.095030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 381/782] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:44 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:45.294913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-29d19b84-e91a-46d9-a728-d02d29f76075 req-7c0761c3-db54-45f8-aee2-66d49aced8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b7e802-d8bf-452b-82be-12efdc250b46", "tag": "e80d171e-4244-48ec-b54d-f70de4dd3c2b"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:45.304777 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-29d19b84-e91a-46d9-a728-d02d29f76075 req-7c0761c3-db54-45f8-aee2-66d49aced8ad service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:45.305221 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-29d19b84-e91a-46d9-a728-d02d29f76075 req-7c0761c3-db54-45f8-aee2-66d49aced8ad service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:45.317235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-29d19b84-e91a-46d9-a728-d02d29f76075 req-7c0761c3-db54-45f8-aee2-66d49aced8ad service nova] Creating event network-changed:e80d171e-4244-48ec-b54d-f70de4dd3c2b for instance 10b7e802-d8bf-452b-82be-12efdc250b46 on hv-cinder-74014 Aug 04 02:43:45.322245 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-29d19b84-e91a-46d9-a728-d02d29f76075 req-7c0761c3-db54-45f8-aee2-66d49aced8ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 Aug 04 02:43:45.322938 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 402/783] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:46.109831 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:46.110527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:46.117974 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:46.118440 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:46.119518 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:46.119786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:46.253257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:46.260782 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8da7a931-7a09-4a70-991d-c04e5265665d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1366 microversion: 2.1 time: 0.155467 Aug 04 02:43:46.261356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 382/784] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:46 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:47.283480 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:47.284093 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:47.290508 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:47.290978 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:47.291769 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:47.292208 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:47.428821 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:47.436844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2350fbe7-4070-4afa-b03b-49bfd20be4ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1366 microversion: 2.1 time: 0.158139 Aug 04 02:43:47.437412 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 403/785] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:47 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:48.457247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:48.457865 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:48.464413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:48.464865 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:48.465637 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:48.466089 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:48.601025 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:48.608477 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-40da4e7d-8ac0-4fdc-86ae-94fca2400568 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1366 microversion: 2.1 time: 0.155156 Aug 04 02:43:48.609042 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 383/786] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:48 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:49.629248 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:49.629955 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:49.636688 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:49.637910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:49.638801 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:49.639284 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:49.868358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-baf0ed33-5691-4572-afd5-8863e8446401 req-cf487ed2-4389-428a-9704-5a3ba2a3d70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b7e802-d8bf-452b-82be-12efdc250b46", "name": "network-vif-plugged", "status": "completed", "tag": "e80d171e-4244-48ec-b54d-f70de4dd3c2b"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:49.880378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-baf0ed33-5691-4572-afd5-8863e8446401 req-cf487ed2-4389-428a-9704-5a3ba2a3d70b service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:49.880934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-baf0ed33-5691-4572-afd5-8863e8446401 req-cf487ed2-4389-428a-9704-5a3ba2a3d70b service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:49.892876 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-baf0ed33-5691-4572-afd5-8863e8446401 req-cf487ed2-4389-428a-9704-5a3ba2a3d70b service nova] Creating event network-vif-plugged:e80d171e-4244-48ec-b54d-f70de4dd3c2b for instance 10b7e802-d8bf-452b-82be-12efdc250b46 on hv-cinder-74014 Aug 04 02:43:49.898174 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-baf0ed33-5691-4572-afd5-8863e8446401 req-cf487ed2-4389-428a-9704-5a3ba2a3d70b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034011 Aug 04 02:43:49.898812 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 384/787] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:49.936722 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:49.944416 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9df5c13b-306f-4b6d-b5ad-35d2e2873d39 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1366 microversion: 2.1 time: 0.318964 Aug 04 02:43:49.945387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 404/788] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:49 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:50.967910 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:50.968636 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:50.975017 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:50.975485 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:50.976381 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:50.976826 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:51.111267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:51.118936 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-025f604b-acf3-41be-8031-992dee05aa04 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1366 microversion: 2.1 time: 0.156294 Aug 04 02:43:51.119564 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 385/789] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:50 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:52.141043 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:52.141908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:52.144369 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=6 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:52.149215 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:52.149663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:52.150428 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:52.150962 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:52.280659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:52.288192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0c69d18c-c1d0-4dad-9e69-ce081076d96b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1556 microversion: 2.1 time: 0.151996 Aug 04 02:43:52.288825 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 405/790] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:52 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:52.308421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3cc4086a-366d-4a7a-b67b-4be8b558bdd0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:52.308952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3cc4086a-366d-4a7a-b67b-4be8b558bdd0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:52.311524 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:52.312304 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=6 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:52.317520 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3cc4086a-366d-4a7a-b67b-4be8b558bdd0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:52.317972 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3cc4086a-366d-4a7a-b67b-4be8b558bdd0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:52.318774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3cc4086a-366d-4a7a-b67b-4be8b558bdd0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:52.319217 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3cc4086a-366d-4a7a-b67b-4be8b558bdd0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:52.396137 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3cc4086a-366d-4a7a-b67b-4be8b558bdd0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091437 Aug 04 02:43:52.396739 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 386/791] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:43:52 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:53.396943 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-6adcab3c-288a-4c00-869e-86abcca43c8c req-b86d5182-2941-4452-b8cf-879cf776982c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b7e802-d8bf-452b-82be-12efdc250b46", "tag": "e80d171e-4244-48ec-b54d-f70de4dd3c2b"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:53.407064 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-6adcab3c-288a-4c00-869e-86abcca43c8c req-b86d5182-2941-4452-b8cf-879cf776982c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:53.407505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-6adcab3c-288a-4c00-869e-86abcca43c8c req-b86d5182-2941-4452-b8cf-879cf776982c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:53.420448 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-6adcab3c-288a-4c00-869e-86abcca43c8c req-b86d5182-2941-4452-b8cf-879cf776982c service nova] Creating event network-changed:e80d171e-4244-48ec-b54d-f70de4dd3c2b for instance 10b7e802-d8bf-452b-82be-12efdc250b46 on hv-cinder-74014 Aug 04 02:43:53.425636 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-6adcab3c-288a-4c00-869e-86abcca43c8c req-b86d5182-2941-4452-b8cf-879cf776982c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Aug 04 02:43:53.426239 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 406/792] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:57.504957 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:57.505445 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:57.508304 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-120383fe-ee16-46ca-a18a-9897d8476cc1 req-2aabdd9b-5963-4b89-a95d-0fbe378878d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680f726e-1314-4d14-a8e1-1752f6efc2f3", "tag": "297fbec7-3f62-4364-b1a7-6b0b689eede7"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:57.513256 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:57.514071 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:57.515570 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:57.516106 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:57.519266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-120383fe-ee16-46ca-a18a-9897d8476cc1 req-2aabdd9b-5963-4b89-a95d-0fbe378878d1 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:57.519708 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-120383fe-ee16-46ca-a18a-9897d8476cc1 req-2aabdd9b-5963-4b89-a95d-0fbe378878d1 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:57.531170 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-120383fe-ee16-46ca-a18a-9897d8476cc1 req-2aabdd9b-5963-4b89-a95d-0fbe378878d1 service nova] Creating event network-changed:297fbec7-3f62-4364-b1a7-6b0b689eede7 for instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 on hv-cinder-74014 Aug 04 02:43:57.536606 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-120383fe-ee16-46ca-a18a-9897d8476cc1 req-2aabdd9b-5963-4b89-a95d-0fbe378878d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 Aug 04 02:43:57.537375 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 407/793] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:43:57.543579 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:43:57.814018 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ee0fb3af-10e2-469a-be1a-319a57ab349a tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "DELETE /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 204 len: 0 microversion: 2.1 time: 0.313246 Aug 04 02:43:57.818287 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 387/794] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:43:57 2022] DELETE /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:43:57.823901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:57.825542 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:57.837406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:57.838103 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:57.840649 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:57.841080 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:57.983750 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:57.991302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f6e8cf24-6383-46a8-8ce8-3c79d93b5308 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.171814 Aug 04 02:43:57.991868 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 408/795] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:57 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:43:59.013784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:43:59.015317 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:43:59.021728 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:59.022178 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:59.022979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:59.023421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:59.187146 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:43:59.195524 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-28188894-7158-4207-9c91-cefd102f7bcd tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1569 microversion: 2.1 time: 0.185970 Aug 04 02:43:59.196116 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 388/796] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:43:59 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:43:59.884546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-8748aeb5-12b9-4a9b-b630-9c1c4190a04e req-ddce475d-2aa2-452b-8945-44aabc9f7d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680f726e-1314-4d14-a8e1-1752f6efc2f3", "name": "network-vif-deleted", "tag": "297fbec7-3f62-4364-b1a7-6b0b689eede7"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:43:59.895812 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-8748aeb5-12b9-4a9b-b630-9c1c4190a04e req-ddce475d-2aa2-452b-8945-44aabc9f7d38 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:43:59.896256 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-8748aeb5-12b9-4a9b-b630-9c1c4190a04e req-ddce475d-2aa2-452b-8945-44aabc9f7d38 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:43:59.907962 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-8748aeb5-12b9-4a9b-b630-9c1c4190a04e req-ddce475d-2aa2-452b-8945-44aabc9f7d38 service nova] Creating event network-vif-deleted:297fbec7-3f62-4364-b1a7-6b0b689eede7 for instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 on hv-cinder-74014 Aug 04 02:43:59.996941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-8748aeb5-12b9-4a9b-b630-9c1c4190a04e req-ddce475d-2aa2-452b-8945-44aabc9f7d38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032980 Aug 04 02:43:59.996941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 409/797] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:00.217583 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:00.218237 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:00.228268 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:00.229324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:00.230302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:00.230960 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:00.311380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:00.319716 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9988e53d-0d1f-42ba-9d6f-af4a58b4772e tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1220 microversion: 2.1 time: 0.106150 Aug 04 02:44:00.320307 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 389/798] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:00 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:01.342465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:01.343523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:01.350740 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:01.351189 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:01.351951 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:01.352386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:01.384387 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:01.384833 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:01.385677 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lazy-loading 'fault' on Instance uuid 680f726e-1314-4d14-a8e1-1752f6efc2f3 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:44:01.431704 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5091a0547e964c6d80b947191072e809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49dcb863cd24a3cab8162c18ddf78f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:01.439428 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5a5e3f3d-5664-47a6-9dec-ccec36ab9b06 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 200 len: 1225 microversion: 2.1 time: 0.101853 Aug 04 02:44:01.439990 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 410/799] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:01 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:01.858946 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:44:01.859712 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:44:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:44:02.460571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:02.461120 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] [instance: 680f726e-1314-4d14-a8e1-1752f6efc2f3] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:02.467979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:02.468425 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:02.469190 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:02.470114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:02.484048 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] HTTP exception thrown: Instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 could not be found. Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Request method failure captured: Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 HTTP/1.1 Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zFB4ywPcHadARP-QKg13ckLMJP5ZEtQ4BuwqqpkCuG2xYoiV__-98aDcjvRWor4j3VcdVFoSXQ53ygv8MAIVLt8VGL-CFvPv5kqJffx0JYbY_LhCEylcuY4qq8PDOVztHroyYmBddKThKXJOVGMfPZwFgjElPszBilGInCUuJiMb3I Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: a49dcb863cd24a3cab8162c18ddf78f0 Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-TestShelveInstance-1612921265 Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:44:02.486590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49dcb863cd24a3cab8162c18ddf78f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49dcb863cd24a3cab8162c18ddf78f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a49dcb863cd24a3cab8162c18ddf78f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a49dcb863cd24a3cab8162c18ddf78f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-TestShelveInstance-1612921265 Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: a49dcb863cd24a3cab8162c18ddf78f0 Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-TestShelveInstance-1612921265 Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-TestShelveInstance-1612921265-project Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 5091a0547e964c6d80b947191072e809 Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-TestShelveInstance-1612921265-project Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 could not be found. Aug 04 02:44:02.488024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '680f726e-1314-4d14-a8e1-1752f6efc2f3'} Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 could not be found. Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:44:02.489100 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 could not be found. Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 could not be found. Aug 04 02:44:02.490764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:44:02.492358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Returning 404 to user: Instance 680f726e-1314-4d14-a8e1-1752f6efc2f3 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:44:02.492358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2ebd1385-446d-454c-a6c0-6f1380fd7cd5 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3" status: 404 len: 111 microversion: 2.1 time: 0.031389 Aug 04 02:44:02.492358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 390/800] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:02 2022] GET /compute/v2.1/servers/680f726e-1314-4d14-a8e1-1752f6efc2f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:44:02.733332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-be527531-b6aa-4d46-8d83-7b9aedc88045 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] Calling method '.version_select at 0x7fa6461f7e50>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:02.815991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-be527531-b6aa-4d46-8d83-7b9aedc88045 tempest-TestShelveInstance-1612921265 tempest-TestShelveInstance-1612921265-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1504962787" status: 202 len: 0 microversion: 2.1 time: 0.086802 Aug 04 02:44:02.816921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 411/801] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 4 02:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1504962787 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:44:04.799832 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2128080587", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "networks": [{"uuid": "d5394270-9105-4427-a469-382a09fee1cb"}]}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:04.855615 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] validate_networks() for [('d5394270-9105-4427-a469-382a09fee1cb', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:44:05.225303 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:44:05.225720 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:44:05.226189 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:44:05.226612 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:44:05.227021 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:44:05.237004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:05.237652 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:05.238521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:05.238995 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:05.260594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Getting quotas for project 4c8e5c8f08a44e60aa29e84422acf26c. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:44:05.264933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Getting quotas for user 0b027a7cb06b49aa9f5ea95cf0603979 and project 4c8e5c8f08a44e60aa29e84422acf26c. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:44:05.276975 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:44:05.279516 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:44:05.426697 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-48855484-7d7c-4fac-8443-e2c0423e3d2d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630905 Aug 04 02:44:05.429326 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 391/802] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:44:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:44:05.438774 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-91a33aad-f9bc-42c6-a721-9150e61cb04c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:05.439573 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-91a33aad-f9bc-42c6-a721-9150e61cb04c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:05.503561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-91a33aad-f9bc-42c6-a721-9150e61cb04c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:05.510293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-91a33aad-f9bc-42c6-a721-9150e61cb04c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1219 microversion: 2.1 time: 0.075403 Aug 04 02:44:05.511095 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 412/803] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:05 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:06.532928 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:06.539887 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:06.552345 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:06.552800 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:06.553650 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:06.554087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:06.679514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:06.688587 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b5a3704e-67af-4f0f-8454-16833b21afda tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1223 microversion: 2.1 time: 0.160594 Aug 04 02:44:06.689747 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 392/804] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:06 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1223 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:07.714163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:07.716211 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:07.731038 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:07.731523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:07.734303 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:07.734303 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:07.853631 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:07.861916 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6c4448a7-7b56-4734-937b-5b9087c38462 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1279 microversion: 2.1 time: 0.156395 Aug 04 02:44:07.879071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 413/805] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:07 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:08.891864 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:08.892476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:08.899689 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:08.900141 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:08.900923 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:08.901361 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:09.110516 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:09.119380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-eef987d2-db76-49d0-9784-8da9a9decebc tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.231560 Aug 04 02:44:09.130725 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 393/806] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:08 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:09.966709 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-d0648dac-892b-4faf-bb87-bdf486560786 req-22179942-9e8b-4fb5-89af-b441d3e379ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf87847-5fc6-469d-af62-a6277ea39c43", "tag": "a142c5fe-545e-4724-9193-9663b771f30a"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:09.978276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-d0648dac-892b-4faf-bb87-bdf486560786 req-22179942-9e8b-4fb5-89af-b441d3e379ea service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:09.978785 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-d0648dac-892b-4faf-bb87-bdf486560786 req-22179942-9e8b-4fb5-89af-b441d3e379ea service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:09.990625 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-d0648dac-892b-4faf-bb87-bdf486560786 req-22179942-9e8b-4fb5-89af-b441d3e379ea service nova] Creating event network-changed:a142c5fe-545e-4724-9193-9663b771f30a for instance fdf87847-5fc6-469d-af62-a6277ea39c43 on hv-cinder-74014 Aug 04 02:44:09.995864 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-d0648dac-892b-4faf-bb87-bdf486560786 req-22179942-9e8b-4fb5-89af-b441d3e379ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033617 Aug 04 02:44:09.996878 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 414/807] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:44:10.141228 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:10.141854 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:10.148573 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:10.152929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:10.152929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:10.152929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:10.368407 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:10.377740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-bbcd34ef-9792-4924-b066-665535bef339 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.240365 Aug 04 02:44:10.378993 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 394/808] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:10 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:11.400427 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:11.401128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:11.408041 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:11.408490 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:11.409848 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:11.410288 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:11.559215 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:11.561472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=59 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:11.567796 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ba693907-b58b-401d-99bb-6c7b97078260 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.171565 Aug 04 02:44:11.568381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 415/809] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:11 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:12.588959 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:12.589571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:12.592132 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:12.597487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:12.598020 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:12.598850 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:12.599284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:12.602431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:12.744660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:12.752664 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d2e4d8e8-cc5e-45a6-b870-67d83733404c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.167616 Aug 04 02:44:12.753876 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 395/810] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:12 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:13.773831 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:13.774441 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:13.779565 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:13.785357 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:13.785906 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:13.786711 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:13.787294 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:13.926567 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:13.937018 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-df5c6ff6-a58f-4994-a848-055e7d08cf67 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.166727 Aug 04 02:44:13.937603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 416/811] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:13 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:14.966674 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:14.967325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:14.974592 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:14.975045 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:14.975810 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:14.976247 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:15.106216 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:15.113916 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d57a3e8e-1c82-461a-a87c-cb10fca35cb0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.151418 Aug 04 02:44:15.114499 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 396/812] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:14 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:16.003472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-7cc129ad-0aea-49e5-a4ef-03704336197b req-fbb800e7-e105-499d-bd1c-df48d08b9d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf87847-5fc6-469d-af62-a6277ea39c43", "name": "network-vif-plugged", "status": "completed", "tag": "a142c5fe-545e-4724-9193-9663b771f30a"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:16.008784 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:16.014149 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-7cc129ad-0aea-49e5-a4ef-03704336197b req-fbb800e7-e105-499d-bd1c-df48d08b9d55 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:16.014617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-7cc129ad-0aea-49e5-a4ef-03704336197b req-fbb800e7-e105-499d-bd1c-df48d08b9d55 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:16.027424 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-7cc129ad-0aea-49e5-a4ef-03704336197b req-fbb800e7-e105-499d-bd1c-df48d08b9d55 service nova] Creating event network-vif-plugged:a142c5fe-545e-4724-9193-9663b771f30a for instance fdf87847-5fc6-469d-af62-a6277ea39c43 on hv-cinder-74014 Aug 04 02:44:16.030738 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-7cc129ad-0aea-49e5-a4ef-03704336197b req-fbb800e7-e105-499d-bd1c-df48d08b9d55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 Aug 04 02:44:16.031318 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 417/813] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:16.134758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:16.135365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:16.137236 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:16.137896 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=6 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:16.143441 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:16.143955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:16.144801 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:16.145128 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:16.283554 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:16.292063 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-135933b4-0361-488b-bb16-0ff1ffebb74d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.161328 Aug 04 02:44:16.292647 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 397/814] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:16 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:17.314517 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:17.315808 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:17.323069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:17.323520 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:17.324285 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:17.324725 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:17.460593 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:17.468023 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e2f45e31-eeac-4899-a0f3-49f3f532ae79 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1319 microversion: 2.1 time: 0.157806 Aug 04 02:44:17.468581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 418/815] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:17 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:18.489351 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:18.489964 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:18.496474 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:18.496927 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:18.497694 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:18.498137 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:18.625042 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:18.633127 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c09f1410-d24b-4aaa-8c5a-a124f8a7458c tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1507 microversion: 2.1 time: 0.148005 Aug 04 02:44:18.633688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 398/816] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:18 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:29.744124 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-f4ae5b22-4900-4ffd-9539-d0d5e24f0ac5 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:29.744621 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-f4ae5b22-4900-4ffd-9539-d0d5e24f0ac5 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:29.746699 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=5 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:29.747406 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=15 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:29.752274 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f4ae5b22-4900-4ffd-9539-d0d5e24f0ac5 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:29.752721 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f4ae5b22-4900-4ffd-9539-d0d5e24f0ac5 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:29.758444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f4ae5b22-4900-4ffd-9539-d0d5e24f0ac5 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:29.758444 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-f4ae5b22-4900-4ffd-9539-d0d5e24f0ac5 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:29.778014 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-f4ae5b22-4900-4ffd-9539-d0d5e24f0ac5 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/ips" status: 200 len: 149 microversion: 2.1 time: 0.037978 Aug 04 02:44:29.778604 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 419/817] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:44:29 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:31.455631 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-39b2b084-9dfc-4a23-b191-8aee2e98d5ab tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34ed73b8-67d5-4b85-800f-ad46129862ec"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:31.458567 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-39b2b084-9dfc-4a23-b191-8aee2e98d5ab tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:31.460686 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=7 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:31.461366 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=23 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:31.466109 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-39b2b084-9dfc-4a23-b191-8aee2e98d5ab tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:31.469341 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-39b2b084-9dfc-4a23-b191-8aee2e98d5ab tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:31.469341 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-39b2b084-9dfc-4a23-b191-8aee2e98d5ab tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:31.469341 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-39b2b084-9dfc-4a23-b191-8aee2e98d5ab tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:31.975719 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ce61438a-6daf-4306-b724-c0151e620580 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e51d4363-9025-4a96-b9bb-fd6d40ee18eb", "device": "/dev/sdb"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:31.980610 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ce61438a-6daf-4306-b724-c0151e620580 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:31.985115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce61438a-6daf-4306-b724-c0151e620580 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:31.985560 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce61438a-6daf-4306-b724-c0151e620580 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:31.986315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce61438a-6daf-4306-b724-c0151e620580 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:31.986780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ce61438a-6daf-4306-b724-c0151e620580 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:32.292365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-39b2b084-9dfc-4a23-b191-8aee2e98d5ab tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840538 Aug 04 02:44:32.292999 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 399/818] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:44:31 2022] POST /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:32.764913 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ce61438a-6daf-4306-b724-c0151e620580 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "POST /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.793817 Aug 04 02:44:32.765448 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 420/819] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:44:31 2022] POST /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:44:34.548725 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-aac46156-7898-414d-ba82-0fa0b262349b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: .version_select at 0x7fa64699ed30>, body: {"keypair": {"name": "tempest-keypair-1839893866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF/RTkp2iwqy48/M0MI1bw+i+Wp/MjQ4W8zZrqERT/bGTzLl6qAVEhds0BJKe1ZAvYXZzE4gRjsHnq1uIxL2EqO7gENBbjNZHPPeVTMdEinFhynRstVMhdd7bBiAQ2nww=="}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:34.564964 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-aac46156-7898-414d-ba82-0fa0b262349b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:44:34.568712 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-aac46156-7898-414d-ba82-0fa0b262349b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:44:34.669741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-aac46156-7898-414d-ba82-0fa0b262349b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125936 Aug 04 02:44:34.670365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 400/820] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:44:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:36.532218 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-a143eb64-1fb1-4811-9b52-7ada1e623899 req-eecadd62-a356-4afd-8f4e-6d8670eb4d86 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e51d4363-9025-4a96-b9bb-fd6d40ee18eb", "create_info": {"type": "qcow2", "new_file": "volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.0d26e441-bcb9-4725-b623-abaed6db981e.vhdx", "snapshot_id": "0d26e441-bcb9-4725-b623-abaed6db981e"}}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:36.541449 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [req-a143eb64-1fb1-4811-9b52-7ada1e623899 req-eecadd62-a356-4afd-8f4e-6d8670eb4d86 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d67d506-3efa-49a4-9082-a0012026440f(cell1) {{(pid=124997) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 02:44:36.541924 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a143eb64-1fb1-4811-9b52-7ada1e623899 req-eecadd62-a356-4afd-8f4e-6d8670eb4d86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:36.542363 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a143eb64-1fb1-4811-9b52-7ada1e623899 req-eecadd62-a356-4afd-8f4e-6d8670eb4d86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:36.579021 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a143eb64-1fb1-4811-9b52-7ada1e623899 req-eecadd62-a356-4afd-8f4e-6d8670eb4d86 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:36.579477 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-a143eb64-1fb1-4811-9b52-7ada1e623899 req-eecadd62-a356-4afd-8f4e-6d8670eb4d86 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:36.602389 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-a143eb64-1fb1-4811-9b52-7ada1e623899 req-eecadd62-a356-4afd-8f4e-6d8670eb4d86 admin admin] 10.222.0.64 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.259098 Aug 04 02:44:36.603027 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 421/821] 10.222.0.64 () {64 vars in 1326 bytes} [Thu Aug 4 02:44:36 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:44:37.221673 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1870802562", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "504f11d1-22cf-4971-a6d4-d7b56ff2e4da"}], "security_groups": [{"name": "tempest-securitygroup--848941537"}], "key_name": "tempest-keypair-1839893866", "user_data": "}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:37.330295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.network.neutron [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] validate_networks() for [('504f11d1-22cf-4971-a6d4-d7b56ff2e4da', None, None, None, None, None)] {{(pid=124996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:44:37.704427 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:44:37.704862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image limits 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:44:37.705330 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:44:37.705768 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image pref 0:0:0 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:44:37.706183 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.virt.hardware [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:44:37.715253 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:37.715697 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:37.716494 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:37.716930 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:37.734013 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:44:37.738091 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:44:37.749985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Going to run 1 instances... {{(pid=124996) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:44:37.752301 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:44:37.882161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ef498ea2-f578-4b9d-bc47-818400144f73 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.665260 Aug 04 02:44:37.882875 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 401/822] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:44:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:44:37.895179 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-18ad40c1-b9a7-483c-8329-ac70407fa546 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:37.895871 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-18ad40c1-b9a7-483c-8329-ac70407fa546 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:37.952349 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-18ad40c1-b9a7-483c-8329-ac70407fa546 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:37.959094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-18ad40c1-b9a7-483c-8329-ac70407fa546 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1242 microversion: 2.1 time: 0.068755 Aug 04 02:44:37.959661 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 422/823] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:37 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:38.980688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:38.981244 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:38.989174 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:38.989626 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:38.990402 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:38.990866 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:39.057750 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:39.065211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ea796ade-1d7b-4761-855a-77e969951a12 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1246 microversion: 2.1 time: 0.088672 Aug 04 02:44:39.065785 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 402/824] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:38 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:44:40.087139 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:40.087846 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:40.096589 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:40.097029 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:40.097802 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:40.098229 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:40.165754 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:40.173551 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1138d336-7da4-4eeb-ae30-12635d8224ea tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1312 microversion: 2.1 time: 0.091980 Aug 04 02:44:40.180938 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 423/825] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:40 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:40.556884 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-004e3553-592e-4499-9c32-89cd37095b52 req-e72a0c26-6aa5-4405-8a86-73a07668eb49 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e51d4363-9025-4a96-b9bb-fd6d40ee18eb", "create_info": {"type": "qcow2", "new_file": "volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.26ab6f66-9fda-4dae-b9fa-7e4f1050bcf0.vhdx", "snapshot_id": "26ab6f66-9fda-4dae-b9fa-7e4f1050bcf0"}}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:40.565386 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [req-004e3553-592e-4499-9c32-89cd37095b52 req-e72a0c26-6aa5-4405-8a86-73a07668eb49 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d67d506-3efa-49a4-9082-a0012026440f(cell1) {{(pid=124996) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 02:44:40.565928 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-004e3553-592e-4499-9c32-89cd37095b52 req-e72a0c26-6aa5-4405-8a86-73a07668eb49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:40.566367 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-004e3553-592e-4499-9c32-89cd37095b52 req-e72a0c26-6aa5-4405-8a86-73a07668eb49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:40.606394 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-004e3553-592e-4499-9c32-89cd37095b52 req-e72a0c26-6aa5-4405-8a86-73a07668eb49 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:40.606871 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-004e3553-592e-4499-9c32-89cd37095b52 req-e72a0c26-6aa5-4405-8a86-73a07668eb49 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:40.633259 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-004e3553-592e-4499-9c32-89cd37095b52 req-e72a0c26-6aa5-4405-8a86-73a07668eb49 admin admin] 10.222.0.64 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.134657 Aug 04 02:44:40.634319 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 403/826] 10.222.0.64 () {64 vars in 1326 bytes} [Thu Aug 4 02:44:40 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:44:41.195886 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:41.196584 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:41.203167 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:41.203623 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:41.204388 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:41.204826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:41.334065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:41.341958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-02939b70-f84d-41d6-a819-b10d8f8f2661 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1367 microversion: 2.1 time: 0.150627 Aug 04 02:44:41.342552 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 424/827] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:41 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:41.932243 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-7970b546-f5cc-4b24-b92f-b398125bd559 req-b0ec7889-e578-43a7-8afb-1cdb4021335d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218d0afe-849b-4a0f-96e4-caf2afd7c4bf", "tag": "1a7bbc44-2b68-433b-a986-b3c818c8e45f"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:41.943835 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-7970b546-f5cc-4b24-b92f-b398125bd559 req-b0ec7889-e578-43a7-8afb-1cdb4021335d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:41.944285 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-7970b546-f5cc-4b24-b92f-b398125bd559 req-b0ec7889-e578-43a7-8afb-1cdb4021335d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:41.956347 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-7970b546-f5cc-4b24-b92f-b398125bd559 req-b0ec7889-e578-43a7-8afb-1cdb4021335d service nova] Creating event network-changed:1a7bbc44-2b68-433b-a986-b3c818c8e45f for instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf on hv-cinder-74014 Aug 04 02:44:41.961702 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-7970b546-f5cc-4b24-b92f-b398125bd559 req-b0ec7889-e578-43a7-8afb-1cdb4021335d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034401 Aug 04 02:44:41.962334 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 404/828] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:42.363329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:42.363948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:42.370826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:42.371315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:42.372110 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:42.372545 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:42.506087 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:42.514328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fb517f78-b976-4b9d-851d-4a15bbefdec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1367 microversion: 2.1 time: 0.154830 Aug 04 02:44:42.514942 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 425/829] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:42 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:43.535883 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:43.536583 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:43.543779 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:43.544229 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:43.544987 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:43.545421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:43.680698 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:43.688399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-aad4672c-ab9d-48cc-81a7-b5e03f973b50 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1367 microversion: 2.1 time: 0.156830 Aug 04 02:44:43.688973 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 405/830] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:43 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:43.922940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-0948862d-a6e1-48b6-a367-eb2e7ecfbd49 req-7561e19e-5081-4d04-b2cc-ae92923edbb1 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e51d4363-9025-4a96-b9bb-fd6d40ee18eb", "create_info": {"type": "qcow2", "new_file": "volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.436252cc-eacc-401a-855a-9f76868a034d.vhdx", "snapshot_id": "436252cc-eacc-401a-855a-9f76868a034d"}}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:43.926326 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0948862d-a6e1-48b6-a367-eb2e7ecfbd49 req-7561e19e-5081-4d04-b2cc-ae92923edbb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:43.926786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0948862d-a6e1-48b6-a367-eb2e7ecfbd49 req-7561e19e-5081-4d04-b2cc-ae92923edbb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:43.934861 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0948862d-a6e1-48b6-a367-eb2e7ecfbd49 req-7561e19e-5081-4d04-b2cc-ae92923edbb1 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:43.935300 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0948862d-a6e1-48b6-a367-eb2e7ecfbd49 req-7561e19e-5081-4d04-b2cc-ae92923edbb1 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:43.950372 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-0948862d-a6e1-48b6-a367-eb2e7ecfbd49 req-7561e19e-5081-4d04-b2cc-ae92923edbb1 admin admin] 10.222.0.64 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.077458 Aug 04 02:44:43.951041 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 426/831] 10.222.0.64 () {64 vars in 1326 bytes} [Thu Aug 4 02:44:43 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 02:44:44.709496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:44.710109 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:44.716813 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:44.717266 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:44.718027 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:44.718462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:44.844455 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:44.852599 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0c203975-97e3-417a-90bb-75c354ca2108 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1367 microversion: 2.1 time: 0.146105 Aug 04 02:44:44.853244 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 406/832] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:44 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:45.874644 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:45.875346 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:45.881617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:45.882067 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:45.882977 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:45.883557 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:46.027025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:46.027025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-fdf12e01-1861-4d0e-bfd0-ad0c12392e6d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1367 microversion: 2.1 time: 0.154078 Aug 04 02:44:46.027025 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 427/833] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:45 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:46.255330 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-84d4506b-1112-4e8e-9e9e-59241d4b3030 req-dc6d8024-68c9-4672-87c7-1d12175ede38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218d0afe-849b-4a0f-96e4-caf2afd7c4bf", "name": "network-vif-plugged", "status": "completed", "tag": "1a7bbc44-2b68-433b-a986-b3c818c8e45f"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:46.265811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-84d4506b-1112-4e8e-9e9e-59241d4b3030 req-dc6d8024-68c9-4672-87c7-1d12175ede38 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:46.266253 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-84d4506b-1112-4e8e-9e9e-59241d4b3030 req-dc6d8024-68c9-4672-87c7-1d12175ede38 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:46.277526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-84d4506b-1112-4e8e-9e9e-59241d4b3030 req-dc6d8024-68c9-4672-87c7-1d12175ede38 service nova] Creating event network-vif-plugged:1a7bbc44-2b68-433b-a986-b3c818c8e45f for instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf on hv-cinder-74014 Aug 04 02:44:46.282210 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-84d4506b-1112-4e8e-9e9e-59241d4b3030 req-dc6d8024-68c9-4672-87c7-1d12175ede38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030615 Aug 04 02:44:46.282843 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 407/834] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:46.854453 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-0666d547-32cd-4d5b-be39-045090045229 req-102f4dc2-a697-45fb-9abd-fb8a027f39b7 admin admin] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:46.857890 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0666d547-32cd-4d5b-be39-045090045229 req-102f4dc2-a697-45fb-9abd-fb8a027f39b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:46.858390 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0666d547-32cd-4d5b-be39-045090045229 req-102f4dc2-a697-45fb-9abd-fb8a027f39b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:46.866430 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0666d547-32cd-4d5b-be39-045090045229 req-102f4dc2-a697-45fb-9abd-fb8a027f39b7 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:46.867497 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0666d547-32cd-4d5b-be39-045090045229 req-102f4dc2-a697-45fb-9abd-fb8a027f39b7 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:46.880780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-0666d547-32cd-4d5b-be39-045090045229 req-102f4dc2-a697-45fb-9abd-fb8a027f39b7 admin admin] 10.222.0.64 "DELETE /compute/v2.1/os-assisted-volume-snapshots/0d26e441-bcb9-4725-b623-abaed6db981e?delete_info=%7B%22file_to_merge%22:%20%22volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.0d26e441-bcb9-4725-b623-abaed6db981e.vhdx%22,%20%22volume_id%22:%20%22e51d4363-9025-4a96-b9bb-fd6d40ee18eb%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.074643 Aug 04 02:44:46.881581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 428/835] 10.222.0.64 () {62 vars in 1800 bytes} [Thu Aug 4 02:44:46 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/0d26e441-bcb9-4725-b623-abaed6db981e?delete_info=%7B%22file_to_merge%22:%20%22volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.0d26e441-bcb9-4725-b623-abaed6db981e.vhdx%22,%20%22volume_id%22:%20%22e51d4363-9025-4a96-b9bb-fd6d40ee18eb%22%7D => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:44:47.046180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:47.047037 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:47.053309 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:47.053764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:47.054763 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:47.055248 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:47.183605 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:47.191066 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-929d11f4-cad8-4b1a-a385-cf9531b2652c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1367 microversion: 2.1 time: 0.149245 Aug 04 02:44:47.191639 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 408/836] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:47 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:48.213549 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:48.214242 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:48.216678 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:48.222463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:48.222932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:48.224667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:48.224667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:48.356667 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:48.364332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5d783874-eef5-4133-87f9-63accd038d49 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1367 microversion: 2.1 time: 0.155145 Aug 04 02:44:48.364892 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 429/837] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:48 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:49.385444 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:49.386060 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:49.388456 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=10 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:49.393263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:49.398704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:49.398704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:49.398704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:49.521784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:49.529668 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f4be259c-5038-4a0b-bde8-4c5c43b9097c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1557 microversion: 2.1 time: 0.148316 Aug 04 02:44:49.530241 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 409/838] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:49 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:44:49.550129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6119316f-2299-471a-a3ec-c2e70d0fdaf3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:49.550682 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6119316f-2299-471a-a3ec-c2e70d0fdaf3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:49.557695 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6119316f-2299-471a-a3ec-c2e70d0fdaf3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:49.558315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6119316f-2299-471a-a3ec-c2e70d0fdaf3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:49.559115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6119316f-2299-471a-a3ec-c2e70d0fdaf3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:49.559556 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6119316f-2299-471a-a3ec-c2e70d0fdaf3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:49.637896 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6119316f-2299-471a-a3ec-c2e70d0fdaf3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091541 Aug 04 02:44:49.638671 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 430/839] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:44:49 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:50.637574 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=4 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:50.693903 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-fbcc3805-68bc-453a-8483-0440908e9089 req-1247d915-1079-4135-9d06-b1b4fa3a6888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218d0afe-849b-4a0f-96e4-caf2afd7c4bf", "tag": "1a7bbc44-2b68-433b-a986-b3c818c8e45f"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:44:50.703958 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-fbcc3805-68bc-453a-8483-0440908e9089 req-1247d915-1079-4135-9d06-b1b4fa3a6888 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:50.704404 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-fbcc3805-68bc-453a-8483-0440908e9089 req-1247d915-1079-4135-9d06-b1b4fa3a6888 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:50.715458 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-fbcc3805-68bc-453a-8483-0440908e9089 req-1247d915-1079-4135-9d06-b1b4fa3a6888 service nova] Creating event network-changed:1a7bbc44-2b68-433b-a986-b3c818c8e45f for instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf on hv-cinder-74014 Aug 04 02:44:50.720370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-fbcc3805-68bc-453a-8483-0440908e9089 req-1247d915-1079-4135-9d06-b1b4fa3a6888 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088272 Aug 04 02:44:50.721139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 410/840] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:44:51.108329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-b7561d68-81bc-434e-be2f-2becf563726a req-e7f1142f-cc01-4c18-9056-66d157658579 admin admin] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:51.111888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-b7561d68-81bc-434e-be2f-2becf563726a req-e7f1142f-cc01-4c18-9056-66d157658579 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:51.112336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-b7561d68-81bc-434e-be2f-2becf563726a req-e7f1142f-cc01-4c18-9056-66d157658579 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:51.121017 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-b7561d68-81bc-434e-be2f-2becf563726a req-e7f1142f-cc01-4c18-9056-66d157658579 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:51.121462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-b7561d68-81bc-434e-be2f-2becf563726a req-e7f1142f-cc01-4c18-9056-66d157658579 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:51.135702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-b7561d68-81bc-434e-be2f-2becf563726a req-e7f1142f-cc01-4c18-9056-66d157658579 admin admin] 10.222.0.64 "DELETE /compute/v2.1/os-assisted-volume-snapshots/436252cc-eacc-401a-855a-9f76868a034d?delete_info=%7B%22file_to_merge%22:%20%22volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.436252cc-eacc-401a-855a-9f76868a034d.vhdx%22,%20%22volume_id%22:%20%22e51d4363-9025-4a96-b9bb-fd6d40ee18eb%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.096779 Aug 04 02:44:51.136599 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 431/841] 10.222.0.64 () {62 vars in 1800 bytes} [Thu Aug 4 02:44:51 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/436252cc-eacc-401a-855a-9f76868a034d?delete_info=%7B%22file_to_merge%22:%20%22volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.436252cc-eacc-401a-855a-9f76868a034d.vhdx%22,%20%22volume_id%22:%20%22e51d4363-9025-4a96-b9bb-fd6d40ee18eb%22%7D => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:44:54.323666 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-45ac1f52-fba5-4e72-9896-efb30e8f475f req-21e67310-260f-4d1c-9d60-1055d5d3df38 admin admin] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:54.326963 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-45ac1f52-fba5-4e72-9896-efb30e8f475f req-21e67310-260f-4d1c-9d60-1055d5d3df38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:54.327413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-45ac1f52-fba5-4e72-9896-efb30e8f475f req-21e67310-260f-4d1c-9d60-1055d5d3df38 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:54.338653 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-45ac1f52-fba5-4e72-9896-efb30e8f475f req-21e67310-260f-4d1c-9d60-1055d5d3df38 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:54.339108 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-45ac1f52-fba5-4e72-9896-efb30e8f475f req-21e67310-260f-4d1c-9d60-1055d5d3df38 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:54.352753 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-45ac1f52-fba5-4e72-9896-efb30e8f475f req-21e67310-260f-4d1c-9d60-1055d5d3df38 admin admin] 10.222.0.64 "DELETE /compute/v2.1/os-assisted-volume-snapshots/26ab6f66-9fda-4dae-b9fa-7e4f1050bcf0?delete_info=%7B%22file_to_merge%22:%20%22volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.26ab6f66-9fda-4dae-b9fa-7e4f1050bcf0.vhdx%22,%20%22volume_id%22:%20%22e51d4363-9025-4a96-b9bb-fd6d40ee18eb%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078380 Aug 04 02:44:54.353324 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 411/842] 10.222.0.64 () {62 vars in 1800 bytes} [Thu Aug 4 02:44:54 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/26ab6f66-9fda-4dae-b9fa-7e4f1050bcf0?delete_info=%7B%22file_to_merge%22:%20%22volume-e51d4363-9025-4a96-b9bb-fd6d40ee18eb.26ab6f66-9fda-4dae-b9fa-7e4f1050bcf0.vhdx%22,%20%22volume_id%22:%20%22e51d4363-9025-4a96-b9bb-fd6d40ee18eb%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:44:57.313990 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:57.314601 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:57.320778 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:57.321263 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:57.322197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:57.322677 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:57.404249 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lazy-loading 'services' on Instance uuid fdf87847-5fc6-469d-af62-a6277ea39c43 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:44:57.589402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5ae51a61-d3af-494e-a181-cada1a6036c0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43/os-volume_attachments/e51d4363-9025-4a96-b9bb-fd6d40ee18eb" status: 202 len: 0 microversion: 2.1 time: 0.279961 Aug 04 02:44:57.589994 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 432/843] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:44:57 2022] DELETE /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43/os-volume_attachments/e51d4363-9025-4a96-b9bb-fd6d40ee18eb => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:44:58.708059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:58.708638 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:58.716430 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:58.716879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:58.717640 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:58.718078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:58.743670 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:44:59.018658 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-117e9c6a-784a-4e8a-a91a-4cfd3e512900 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 204 len: 0 microversion: 2.1 time: 0.314246 Aug 04 02:44:59.019148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 412/844] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:44:58 2022] DELETE /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:44:59.029446 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:44:59.030145 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:44:59.036471 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:59.039049 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:59.039049 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:44:59.039049 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:44:59.172197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:44:59.179548 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-4e036bde-de9e-447c-ae7c-d25c9b428686 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1513 microversion: 2.1 time: 0.155741 Aug 04 02:44:59.180115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 433/845] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:44:59 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:00.199955 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:00.200641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:00.207149 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:00.207594 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:00.208342 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:00.208770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:00.340637 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:00.348098 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3ccf1c17-3ec3-47b7-9eaf-accb09b395ec tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1513 microversion: 2.1 time: 0.152365 Aug 04 02:45:00.348660 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 413/846] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:00 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:01.370788 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:01.371402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:01.373822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=8 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:01.378702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:01.379146 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:01.379901 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:01.380329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:01.507499 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:01.514926 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6e8a0f9e-4aab-4e50-a970-a73eacfe98b0 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1513 microversion: 2.1 time: 0.149064 Aug 04 02:45:01.515492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 434/847] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:01 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:45:02.535004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:02.535663 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:02.537991 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:02.542809 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:02.543253 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:02.544004 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:02.544435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:02.546960 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:02.672571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:02.679891 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0b55fd15-95f4-404c-bddc-4f25727eafcd tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1513 microversion: 2.1 time: 0.148746 Aug 04 02:45:02.680465 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 414/848] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:02 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:03.702158 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:03.702794 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:03.705115 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=29 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:03.709786 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:03.710226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:03.711007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:03.711436 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:03.714629 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:03.846682 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:03.854593 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c93794f7-80d4-49f3-a9f0-9b0d35225168 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1513 microversion: 2.1 time: 0.156300 Aug 04 02:45:03.855159 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 435/849] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:03 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:45:04.746807 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-7963885e-251a-4ae4-8d63-963eb67bb83d req-6db32517-a5c9-45b7-b353-aea309e73fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf87847-5fc6-469d-af62-a6277ea39c43", "name": "network-vif-deleted", "tag": "a142c5fe-545e-4724-9193-9663b771f30a"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:04.752555 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:04.759298 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-7963885e-251a-4ae4-8d63-963eb67bb83d req-6db32517-a5c9-45b7-b353-aea309e73fa1 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:04.759733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-7963885e-251a-4ae4-8d63-963eb67bb83d req-6db32517-a5c9-45b7-b353-aea309e73fa1 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:04.770435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-7963885e-251a-4ae4-8d63-963eb67bb83d req-6db32517-a5c9-45b7-b353-aea309e73fa1 service nova] Creating event network-vif-deleted:a142c5fe-545e-4724-9193-9663b771f30a for instance fdf87847-5fc6-469d-af62-a6277ea39c43 on hv-cinder-74014 Aug 04 02:45:04.775704 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-7963885e-251a-4ae4-8d63-963eb67bb83d req-6db32517-a5c9-45b7-b353-aea309e73fa1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 Aug 04 02:45:04.776280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 415/850] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:04.875457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:04.876063 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:04.883402 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:04.884603 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:04.885419 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:04.885857 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:04.948588 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:04.956173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-6129e5cf-4dc3-41fb-b62c-b4795f096dc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 200 len: 1304 microversion: 2.1 time: 0.084815 Aug 04 02:45:04.956741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 436/851] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:04 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:05.979156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:05.981076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: fdf87847-5fc6-469d-af62-a6277ea39c43] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:05.989026 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:05.989487 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:05.990263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:05.990737 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:06.004862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] HTTP exception thrown: Instance fdf87847-5fc6-469d-af62-a6277ea39c43 could not be found. Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Request method failure captured: Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 HTTP/1.1 Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJyMrB_LYwr5_PTUXpgojIabBq1HEsygx1R-Rpm5Wp1YLVlFlwDtuo3i4Em_5SbqJAXlpMFLHQst6cBO_ZcrTb_4agz1TbpdQzqO4H9IeoimcJuptKrOjMWVF2485w8z4xObFtgCUHudTzFMWxsL6hpjnm4bMe3wgguP4HqAAmUtLg Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 4c8e5c8f08a44e60aa29e84422acf26c Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-VolumesSnapshotTestJSON-626900821 Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:45:06.006510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-VolumesSnapshotTestJSON-626900821 Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 4c8e5c8f08a44e60aa29e84422acf26c Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-626900821 Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-VolumesSnapshotTestJSON-626900821-project Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 0b027a7cb06b49aa9f5ea95cf0603979 Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-VolumesSnapshotTestJSON-626900821-project Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance fdf87847-5fc6-469d-af62-a6277ea39c43 could not be found. Aug 04 02:45:06.008191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': 'fdf87847-5fc6-469d-af62-a6277ea39c43'} Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf87847-5fc6-469d-af62-a6277ea39c43 could not be found. Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:45:06.009359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf87847-5fc6-469d-af62-a6277ea39c43 could not be found. Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf87847-5fc6-469d-af62-a6277ea39c43 could not be found. Aug 04 02:45:06.016522 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:45:06.018177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Returning 404 to user: Instance fdf87847-5fc6-469d-af62-a6277ea39c43 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:45:06.018177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-92231a99-c4b0-4041-81a5-3d20924a7a2e tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43" status: 404 len: 111 microversion: 2.1 time: 0.034838 Aug 04 02:45:06.018177 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 416/852] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:05 2022] GET /compute/v2.1/servers/fdf87847-5fc6-469d-af62-a6277ea39c43 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:45:10.288797 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1695329678", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "networks": [{"uuid": "d5394270-9105-4427-a469-382a09fee1cb"}]}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:10.343093 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] validate_networks() for [('d5394270-9105-4427-a469-382a09fee1cb', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:45:10.684136 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:45:10.684562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:45:10.685039 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:45:10.685452 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:45:10.685898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:45:10.694846 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:10.695298 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:10.696105 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:10.696543 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:10.713851 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Getting quotas for project 4c8e5c8f08a44e60aa29e84422acf26c. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:45:10.718012 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Getting quotas for user 0b027a7cb06b49aa9f5ea95cf0603979 and project 4c8e5c8f08a44e60aa29e84422acf26c. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:45:10.728861 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:45:10.731309 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:45:10.841637 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [3a30e648-f4e4-4fc1-ad23-e742038bf532] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 02:45:11.848428 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO oslo.messaging._drivers.impl_rabbit [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [3a30e648-f4e4-4fc1-ad23-e742038bf532] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 59370. Aug 04 02:45:11.852202 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0a5af83e-8a06-4e88-997e-05aadc208a70 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567319 Aug 04 02:45:11.853023 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 437/853] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:45:11.863494 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f9dbd7eb-e0ec-495b-9e99-a4033ac544a5 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:11.864311 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f9dbd7eb-e0ec-495b-9e99-a4033ac544a5 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:11.919835 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f9dbd7eb-e0ec-495b-9e99-a4033ac544a5 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:11.926631 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f9dbd7eb-e0ec-495b-9e99-a4033ac544a5 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1219 microversion: 2.1 time: 0.066948 Aug 04 02:45:11.927205 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 417/854] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:11 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:12.947132 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:12.947745 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:12.954714 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:12.955162 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:12.955918 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:12.956349 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:13.018291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:13.026007 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-59d5d1fd-3bb8-47b8-8f16-72e045ee6cea tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1223 microversion: 2.1 time: 0.083423 Aug 04 02:45:13.027198 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 438/855] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:12 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:14.049026 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:14.049399 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:14.057058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:14.058231 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:14.059037 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:14.059536 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:14.134914 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:14.142957 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9560f159-e2c4-4147-97dc-367bb1b6fe6b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1289 microversion: 2.1 time: 0.098557 Aug 04 02:45:14.143569 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 418/856] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:14 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:15.164759 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:15.165297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:15.171836 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:15.172294 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:15.173070 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:15.173518 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:15.309973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:15.318850 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e7eb25df-071c-4ff9-847f-e917a05f2b6d tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1319 microversion: 2.1 time: 0.157779 Aug 04 02:45:15.319712 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 439/857] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:15 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:15.585826 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-e26828f2-c464-43e7-98c8-7e7ad27be15f req-6583ddcc-74b5-4fa9-876d-00e740a77876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6071196c-4353-45a5-8fb1-bf12a9df7b2b", "tag": "e31a049f-f3da-43e9-ba8d-d27cd6185d53"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:15.596880 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-e26828f2-c464-43e7-98c8-7e7ad27be15f req-6583ddcc-74b5-4fa9-876d-00e740a77876 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:15.601476 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-e26828f2-c464-43e7-98c8-7e7ad27be15f req-6583ddcc-74b5-4fa9-876d-00e740a77876 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:15.611889 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-e26828f2-c464-43e7-98c8-7e7ad27be15f req-6583ddcc-74b5-4fa9-876d-00e740a77876 service nova] Creating event network-changed:e31a049f-f3da-43e9-ba8d-d27cd6185d53 for instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b on hv-cinder-74014 Aug 04 02:45:15.618792 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-e26828f2-c464-43e7-98c8-7e7ad27be15f req-6583ddcc-74b5-4fa9-876d-00e740a77876 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034856 Aug 04 02:45:15.618792 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 419/858] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:16.342334 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:16.342981 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:16.349560 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:16.351386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:16.351386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:16.351386 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:16.480378 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:16.487780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-aa14f734-384f-4db7-a77a-292e9a5a5eed tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1319 microversion: 2.1 time: 0.150504 Aug 04 02:45:16.488351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 440/859] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:16 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:17.509739 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:17.511114 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:17.517419 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:17.517873 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:17.518666 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:17.519103 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:17.797552 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:17.804935 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-0635c9c8-2a58-421f-9472-71206cd19b29 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1319 microversion: 2.1 time: 0.299998 Aug 04 02:45:17.805503 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 420/860] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:17 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:18.826775 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:18.827381 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:18.833760 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:18.834198 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:18.834980 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:18.835411 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:18.969102 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:18.976476 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-356f1061-1f0e-44e8-91d1-8eb493d1984f tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1319 microversion: 2.1 time: 0.154501 Aug 04 02:45:18.977065 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 441/861] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:18 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:19.997231 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:19.997847 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:20.004289 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:20.004740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:20.005505 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:20.005937 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:20.139514 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:20.145564 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-58e380a6-72ad-4439-ba4c-0f522f846828 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1319 microversion: 2.1 time: 0.152417 Aug 04 02:45:20.146129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 421/862] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:19 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:20.337700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-0cde9e09-a5a6-4440-85d0-a22a22b657d5 req-8501d96e-53be-4180-85e6-ce23d6330cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6071196c-4353-45a5-8fb1-bf12a9df7b2b", "name": "network-vif-plugged", "status": "completed", "tag": "e31a049f-f3da-43e9-ba8d-d27cd6185d53"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:20.348838 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0cde9e09-a5a6-4440-85d0-a22a22b657d5 req-8501d96e-53be-4180-85e6-ce23d6330cc5 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:20.349293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0cde9e09-a5a6-4440-85d0-a22a22b657d5 req-8501d96e-53be-4180-85e6-ce23d6330cc5 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:20.360697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-0cde9e09-a5a6-4440-85d0-a22a22b657d5 req-8501d96e-53be-4180-85e6-ce23d6330cc5 service nova] Creating event network-vif-plugged:e31a049f-f3da-43e9-ba8d-d27cd6185d53 for instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b on hv-cinder-74014 Aug 04 02:45:20.365839 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-0cde9e09-a5a6-4440-85d0-a22a22b657d5 req-8501d96e-53be-4180-85e6-ce23d6330cc5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031896 Aug 04 02:45:20.371302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 442/863] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:21.167947 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:21.168560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:21.175220 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:21.175713 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:21.176473 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:21.176913 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:21.307191 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:21.311658 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ab112faa-d7bc-495b-8424-135dd6447bc3 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1319 microversion: 2.1 time: 0.148225 Aug 04 02:45:21.312232 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 422/864] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:21 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:22.333280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:22.334044 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:22.336088 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:22.336815 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=6 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:22.342631 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:22.343085 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:22.343859 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:22.344297 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:22.473882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:22.482412 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-273aa70a-5613-4afc-815e-8b73f3206671 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1507 microversion: 2.1 time: 0.153403 Aug 04 02:45:22.483009 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 443/865] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:22 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:22.503148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fa4bee44-da3b-4214-a920-bc51a23bfd12 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bf6726e-a4a4-44c9-9ec3-f303813a91f7", "device": "/dev/sdb"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:22.506023 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fa4bee44-da3b-4214-a920-bc51a23bfd12 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:22.509041 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:22.513273 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa4bee44-da3b-4214-a920-bc51a23bfd12 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:22.513723 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa4bee44-da3b-4214-a920-bc51a23bfd12 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:22.514504 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa4bee44-da3b-4214-a920-bc51a23bfd12 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:22.515060 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fa4bee44-da3b-4214-a920-bc51a23bfd12 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:23.210573 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fa4bee44-da3b-4214-a920-bc51a23bfd12 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "POST /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711340 Aug 04 02:45:23.211129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 423/866] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:45:22 2022] POST /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:26.188632 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-57032e86-1f82-4d60-8277-de3e68002779 req-8768e2ff-ad2b-4162-af87-e500aa6295c8 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "0bf6726e-a4a4-44c9-9ec3-f303813a91f7", "create_info": {"type": "qcow2", "new_file": "volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.68dc7b48-de31-4d2e-a3d9-2f4c64753faf.vhdx", "snapshot_id": "68dc7b48-de31-4d2e-a3d9-2f4c64753faf"}}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:26.192135 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-57032e86-1f82-4d60-8277-de3e68002779 req-8768e2ff-ad2b-4162-af87-e500aa6295c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.192739 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-57032e86-1f82-4d60-8277-de3e68002779 req-8768e2ff-ad2b-4162-af87-e500aa6295c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.200894 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-57032e86-1f82-4d60-8277-de3e68002779 req-8768e2ff-ad2b-4162-af87-e500aa6295c8 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.201343 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-57032e86-1f82-4d60-8277-de3e68002779 req-8768e2ff-ad2b-4162-af87-e500aa6295c8 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.215221 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-57032e86-1f82-4d60-8277-de3e68002779 req-8768e2ff-ad2b-4162-af87-e500aa6295c8 admin admin] 10.222.0.64 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.078262 Aug 04 02:45:26.215816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 444/867] 10.222.0.64 () {64 vars in 1326 bytes} [Thu Aug 4 02:45:26 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:45:26.709965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d16ce0ee-558a-43ef-9cee-2d12cce1290b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:26.710634 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d16ce0ee-558a-43ef-9cee-2d12cce1290b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:26.717603 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d16ce0ee-558a-43ef-9cee-2d12cce1290b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.718056 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d16ce0ee-558a-43ef-9cee-2d12cce1290b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.718853 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d16ce0ee-558a-43ef-9cee-2d12cce1290b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.719284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d16ce0ee-558a-43ef-9cee-2d12cce1290b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.741976 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d16ce0ee-558a-43ef-9cee-2d12cce1290b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf/ips" status: 200 len: 150 microversion: 2.1 time: 0.036735 Aug 04 02:45:26.742553 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 424/868] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:45:26 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:26.754742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34ed73b8-67d5-4b85-800f-ad46129862ec"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:26.757165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:26.767546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.767546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.767546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.767546 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.846222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Invalid volume: volume 34ed73b8-67d5-4b85-800f-ad46129862ec is already attached to instances: 10b7e802-d8bf-452b-82be-12efdc250b46 Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: POST /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf/os-volume_attachments HTTP/1.1 Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 74 Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:45:26.848004 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {"volumeAttachment": {"volumeId": "34ed73b8-67d5-4b85-800f-ad46129862ec"}} Aug 04 02:45:26.849834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Invalid volume: volume 34ed73b8-67d5-4b85-800f-ad46129862ec is already attached to instances: 10b7e802-d8bf-452b-82be-12efdc250b46 Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'server_id': '218d0afe-849b-4a0f-96e4-caf2afd7c4bf', 'body': {'volumeAttachment': {'volumeId': '34ed73b8-67d5-4b85-800f-ad46129862ec'}}} Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 34ed73b8-67d5-4b85-800f-ad46129862ec is already attached to instances: 10b7e802-d8bf-452b-82be-12efdc250b46 Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:26.850958 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 34ed73b8-67d5-4b85-800f-ad46129862ec is already attached to instances: 10b7e802-d8bf-452b-82be-12efdc250b46 Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:26.852536 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 34ed73b8-67d5-4b85-800f-ad46129862ec is already attached to instances: 10b7e802-d8bf-452b-82be-12efdc250b46 Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 400 to user: Invalid volume: volume 34ed73b8-67d5-4b85-800f-ad46129862ec is already attached to instances: 10b7e802-d8bf-452b-82be-12efdc250b46 {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2c5aed4a-8c8b-4f22-825e-0ea44ca70d8d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099309 Aug 04 02:45:26.854234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 445/869] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:45:26 2022] POST /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:45:26.858124 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:26.858687 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:26.864613 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.865066 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.865826 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:26.866267 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:26.892471 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:45:27.147831 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-be893ea0-f710-4560-b37f-47437f107064 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 204 len: 0 microversion: 2.1 time: 0.293266 Aug 04 02:45:27.148414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 425/870] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:45:26 2022] DELETE /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:45:27.157088 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:27.160188 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:27.164918 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:27.165368 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:27.166138 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:27.166608 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:27.295819 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:27.303248 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a1374377-3dda-4cf3-85f1-49855922897f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1682 microversion: 2.1 time: 0.150235 Aug 04 02:45:27.303816 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 446/871] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:27 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:28.325936 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:28.326674 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:28.333139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:28.333590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:28.334360 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:28.334830 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:28.467156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:28.474786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4a817fc3-ffe9-49df-b70c-e68863e1a349 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1682 microversion: 2.1 time: 0.153045 Aug 04 02:45:28.475367 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 426/872] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:28 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:29.496834 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:29.497359 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:29.504257 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:29.504709 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:29.505487 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:29.505927 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:29.639957 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:29.648320 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1993fa61-2f86-4e29-ac37-c7365397f896 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1682 microversion: 2.1 time: 0.155684 Aug 04 02:45:29.660222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 447/873] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:29 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:29.918033 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-8fad2d87-8fd7-4298-8078-c73c8858a520 req-c9c3052b-a6da-4ea5-9ca7-3aaad9ed8955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218d0afe-849b-4a0f-96e4-caf2afd7c4bf", "name": "network-vif-deleted", "tag": "1a7bbc44-2b68-433b-a986-b3c818c8e45f"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:29.930711 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8fad2d87-8fd7-4298-8078-c73c8858a520 req-c9c3052b-a6da-4ea5-9ca7-3aaad9ed8955 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:29.931580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-8fad2d87-8fd7-4298-8078-c73c8858a520 req-c9c3052b-a6da-4ea5-9ca7-3aaad9ed8955 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:29.953527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-8fad2d87-8fd7-4298-8078-c73c8858a520 req-c9c3052b-a6da-4ea5-9ca7-3aaad9ed8955 service nova] Creating event network-vif-deleted:1a7bbc44-2b68-433b-a986-b3c818c8e45f for instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf on hv-cinder-74014 Aug 04 02:45:29.953527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-8fad2d87-8fd7-4298-8078-c73c8858a520 req-c9c3052b-a6da-4ea5-9ca7-3aaad9ed8955 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038104 Aug 04 02:45:29.953527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 427/874] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:30.672262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:30.672893 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:30.680427 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:30.680879 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:30.681744 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:30.682296 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:30.717503 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:30.717960 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:30.718424 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lazy-loading 'fault' on Instance uuid 218d0afe-849b-4a0f-96e4-caf2afd7c4bf {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:45:30.764782 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:30.773829 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-17098e03-bd8b-4dd6-9389-fa5306df7d10 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 200 len: 1332 microversion: 2.1 time: 0.105989 Aug 04 02:45:30.774759 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 448/875] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:30 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:30.802959 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-c22ad5e6-8f6d-48c3-85b6-2b823b81ec0b req-8a7a3bbc-0caf-4d1c-9bbe-1d0fa3dc0b2b admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "0bf6726e-a4a4-44c9-9ec3-f303813a91f7", "create_info": {"type": "qcow2", "new_file": "volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.6661a2ad-776f-4030-b51e-441cc38aa24e.vhdx", "snapshot_id": "6661a2ad-776f-4030-b51e-441cc38aa24e"}}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:30.806463 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-c22ad5e6-8f6d-48c3-85b6-2b823b81ec0b req-8a7a3bbc-0caf-4d1c-9bbe-1d0fa3dc0b2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:30.807250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-c22ad5e6-8f6d-48c3-85b6-2b823b81ec0b req-8a7a3bbc-0caf-4d1c-9bbe-1d0fa3dc0b2b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:30.815835 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-c22ad5e6-8f6d-48c3-85b6-2b823b81ec0b req-8a7a3bbc-0caf-4d1c-9bbe-1d0fa3dc0b2b admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:30.816495 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-c22ad5e6-8f6d-48c3-85b6-2b823b81ec0b req-8a7a3bbc-0caf-4d1c-9bbe-1d0fa3dc0b2b admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:30.830732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-c22ad5e6-8f6d-48c3-85b6-2b823b81ec0b req-8a7a3bbc-0caf-4d1c-9bbe-1d0fa3dc0b2b admin admin] 10.222.0.64 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.114169 Aug 04 02:45:30.831432 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 428/876] 10.222.0.64 () {64 vars in 1326 bytes} [Thu Aug 4 02:45:30 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 02:45:31.805433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:31.805983 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:31.812748 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:31.813200 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:31.813968 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:31.814411 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:31.830050 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf HTTP/1.1 Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:45:31.831617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:45:31.833235 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '218d0afe-849b-4a0f-96e4-caf2afd7c4bf'} Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:45:31.834358 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:45:31.835870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:31.837483 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:45:31.837483 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-26f4ec36-dae1-4194-99e2-446e80a5f9e8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 404 len: 111 microversion: 2.1 time: 0.031797 Aug 04 02:45:31.837483 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 449/877] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:31 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:45:31.843627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-8d27ff8f-d480-454f-a4c5-cecb8a7bccb9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '.version_select at 0x7fa6468a6160>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:31.925684 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-8d27ff8f-d480-454f-a4c5-cecb8a7bccb9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839893866" status: 202 len: 0 microversion: 2.1 time: 0.087338 Aug 04 02:45:31.926255 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 429/878] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 4 02:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839893866 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:45:32.936844 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:32.937382 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:32.944129 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:32.944577 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:32.945343 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:32.945780 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:33.025516 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lazy-loading 'services' on Instance uuid 10b7e802-d8bf-452b-82be-12efdc250b46 {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:45:33.235237 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a24ac475-3785-4e66-8354-fd623d8ed339 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments/34ed73b8-67d5-4b85-800f-ad46129862ec" status: 202 len: 0 microversion: 2.1 time: 0.302885 Aug 04 02:45:33.235824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 450/879] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:45:32 2022] DELETE /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments/34ed73b8-67d5-4b85-800f-ad46129862ec => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:45:33.245905 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-a02f33e7-952c-4974-b209-cf19f2746d03 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:33.248368 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-a02f33e7-952c-4974-b209-cf19f2746d03 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:33.254612 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a02f33e7-952c-4974-b209-cf19f2746d03 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:33.261079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a02f33e7-952c-4974-b209-cf19f2746d03 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:33.261079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a02f33e7-952c-4974-b209-cf19f2746d03 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:33.261079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-a02f33e7-952c-4974-b209-cf19f2746d03 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:33.285919 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-a02f33e7-952c-4974-b209-cf19f2746d03 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Aug 04 02:45:33.286400 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 430/880] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:45:33 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:33.709622 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-1aaff285-614b-463c-ba50-7984ed1a44bd req-6f20324d-94c3-4bb1-84f3-f11bb177a9c6 admin admin] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:33.713043 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-1aaff285-614b-463c-ba50-7984ed1a44bd req-6f20324d-94c3-4bb1-84f3-f11bb177a9c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:33.713492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-1aaff285-614b-463c-ba50-7984ed1a44bd req-6f20324d-94c3-4bb1-84f3-f11bb177a9c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:33.722664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-1aaff285-614b-463c-ba50-7984ed1a44bd req-6f20324d-94c3-4bb1-84f3-f11bb177a9c6 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:33.723111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-1aaff285-614b-463c-ba50-7984ed1a44bd req-6f20324d-94c3-4bb1-84f3-f11bb177a9c6 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:33.736660 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-1aaff285-614b-463c-ba50-7984ed1a44bd req-6f20324d-94c3-4bb1-84f3-f11bb177a9c6 admin admin] 10.222.0.64 "DELETE /compute/v2.1/os-assisted-volume-snapshots/6661a2ad-776f-4030-b51e-441cc38aa24e?delete_info=%7B%22file_to_merge%22:%20%22volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.6661a2ad-776f-4030-b51e-441cc38aa24e.vhdx%22,%20%22volume_id%22:%20%220bf6726e-a4a4-44c9-9ec3-f303813a91f7%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080017 Aug 04 02:45:33.737472 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 451/881] 10.222.0.64 () {62 vars in 1800 bytes} [Thu Aug 4 02:45:33 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/6661a2ad-776f-4030-b51e-441cc38aa24e?delete_info=%7B%22file_to_merge%22:%20%22volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.6661a2ad-776f-4030-b51e-441cc38aa24e.vhdx%22,%20%22volume_id%22:%20%220bf6726e-a4a4-44c9-9ec3-f303813a91f7%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:45:34.305411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-17b5806b-e40a-429d-815c-334ff921513e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:34.307566 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-17b5806b-e40a-429d-815c-334ff921513e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:34.314042 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-17b5806b-e40a-429d-815c-334ff921513e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:34.314516 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-17b5806b-e40a-429d-815c-334ff921513e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:34.315264 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-17b5806b-e40a-429d-815c-334ff921513e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:34.315692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-17b5806b-e40a-429d-815c-334ff921513e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:34.345014 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-17b5806b-e40a-429d-815c-334ff921513e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Aug 04 02:45:34.345558 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 431/882] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:45:34 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:35.358340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-436814da-6a86-47d4-aec4-d7a08122999f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:35.360629 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-436814da-6a86-47d4-aec4-d7a08122999f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:35.363038 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:35.368049 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-436814da-6a86-47d4-aec4-d7a08122999f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:35.368499 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-436814da-6a86-47d4-aec4-d7a08122999f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:35.369267 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-436814da-6a86-47d4-aec4-d7a08122999f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:35.369707 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-436814da-6a86-47d4-aec4-d7a08122999f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:35.373407 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:35.400357 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-436814da-6a86-47d4-aec4-d7a08122999f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046888 Aug 04 02:45:35.402873 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 452/883] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:45:35 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:45:35.463551 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:35.464625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:35.467287 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:35.472031 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:35.472479 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:35.473297 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:35.473736 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:35.499379 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:45:35.522685 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:35.812129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1ad68740-1fe6-4b1d-8d96-2838172adb9d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 204 len: 0 microversion: 2.1 time: 0.352138 Aug 04 02:45:35.812721 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 432/884] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:45:35 2022] DELETE /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:45:35.821336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:35.821956 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:35.829080 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:35.829533 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:35.830299 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:35.830770 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:35.960508 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:35.968631 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-c1ac15f6-11f0-4181-a979-4f66db64703f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1680 microversion: 2.1 time: 0.151540 Aug 04 02:45:35.969204 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 453/885] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:35 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:45:36.878222 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-bd2a238c-558e-4568-b52d-2c1e9570a8ad req-ff90714e-2224-45d0-9441-5a2a491046b3 admin admin] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:36.881462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-bd2a238c-558e-4568-b52d-2c1e9570a8ad req-ff90714e-2224-45d0-9441-5a2a491046b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:36.881952 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-bd2a238c-558e-4568-b52d-2c1e9570a8ad req-ff90714e-2224-45d0-9441-5a2a491046b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:36.890984 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-bd2a238c-558e-4568-b52d-2c1e9570a8ad req-ff90714e-2224-45d0-9441-5a2a491046b3 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:36.891370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-bd2a238c-558e-4568-b52d-2c1e9570a8ad req-ff90714e-2224-45d0-9441-5a2a491046b3 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:36.904836 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-bd2a238c-558e-4568-b52d-2c1e9570a8ad req-ff90714e-2224-45d0-9441-5a2a491046b3 admin admin] 10.222.0.64 "DELETE /compute/v2.1/os-assisted-volume-snapshots/9951b4fe-d740-44f1-a017-dd1ae752eea3?delete_info=%7B%22file_to_merge%22:%20%22volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.9951b4fe-d740-44f1-a017-dd1ae752eea3.vhdx%22,%20%22volume_id%22:%20%220bf6726e-a4a4-44c9-9ec3-f303813a91f7%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.075805 Aug 04 02:45:36.905380 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 433/886] 10.222.0.64 () {62 vars in 1800 bytes} [Thu Aug 4 02:45:36 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/9951b4fe-d740-44f1-a017-dd1ae752eea3?delete_info=%7B%22file_to_merge%22:%20%22volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.9951b4fe-d740-44f1-a017-dd1ae752eea3.vhdx%22,%20%22volume_id%22:%20%220bf6726e-a4a4-44c9-9ec3-f303813a91f7%22%7D => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:45:36.989711 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:36.990321 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:36.997557 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:36.997984 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:36.998860 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:36.999293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:37.128089 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:37.135700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-e299abeb-1a70-499a-a26d-b3c9013ec0b2 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1680 microversion: 2.1 time: 0.149791 Aug 04 02:45:37.136979 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 454/887] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:36 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:38.159715 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:38.160645 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:38.166994 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:38.168295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:38.169669 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:38.170319 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:38.380934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:38.388280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1cf3c8c7-7b33-47b6-ba14-35bf3261ecff tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1680 microversion: 2.1 time: 0.233361 Aug 04 02:45:38.389064 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 434/888] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:38 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:39.045659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-e95df455-bf73-4ab9-86eb-f41dc271e281 req-f3bd0507-0610-4d06-9d37-ac4166c023a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b7e802-d8bf-452b-82be-12efdc250b46", "name": "network-vif-deleted", "tag": "e80d171e-4244-48ec-b54d-f70de4dd3c2b"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:39.056356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e95df455-bf73-4ab9-86eb-f41dc271e281 req-f3bd0507-0610-4d06-9d37-ac4166c023a8 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:39.056908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-e95df455-bf73-4ab9-86eb-f41dc271e281 req-f3bd0507-0610-4d06-9d37-ac4166c023a8 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:39.068066 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-e95df455-bf73-4ab9-86eb-f41dc271e281 req-f3bd0507-0610-4d06-9d37-ac4166c023a8 service nova] Creating event network-vif-deleted:e80d171e-4244-48ec-b54d-f70de4dd3c2b for instance 10b7e802-d8bf-452b-82be-12efdc250b46 on hv-cinder-74014 Aug 04 02:45:39.073090 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-e95df455-bf73-4ab9-86eb-f41dc271e281 req-f3bd0507-0610-4d06-9d37-ac4166c023a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032666 Aug 04 02:45:39.073898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 455/889] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:39.410889 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:39.411497 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:39.418971 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:39.419415 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:39.420172 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:39.420600 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:39.451740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:39.452179 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:39.452627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lazy-loading 'fault' on Instance uuid 10b7e802-d8bf-452b-82be-12efdc250b46 {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:45:39.493797 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:39.502659 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-fb83982b-1253-469e-827b-b359b7afa77e tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 200 len: 1331 microversion: 2.1 time: 0.095736 Aug 04 02:45:39.503308 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 435/890] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:39 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:40.524408 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:40.525112 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:40.531870 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:40.532328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:40.533094 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:40.533613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:40.547356 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 HTTP/1.1 Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:45:40.548911 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:45:40.550626 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '10b7e802-d8bf-452b-82be-12efdc250b46'} Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:45:40.551594 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:45:40.553183 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:40.554666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:45:40.554666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-43a47f77-0d63-40a2-8d34-e697f16a28cc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 404 len: 111 microversion: 2.1 time: 0.030745 Aug 04 02:45:40.554666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 456/891] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:40 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:45:40.560038 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-31a0fde4-afa5-4976-bd42-4a52eeb72ea1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '.version_select at 0x7fa6468b4b80>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:40.647822 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-31a0fde4-afa5-4976-bd42-4a52eeb72ea1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-129093981" status: 202 len: 0 microversion: 2.1 time: 0.092251 Aug 04 02:45:40.648413 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 436/892] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 4 02:45:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-129093981 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:45:41.176192 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-52cd6c9f-cf74-478a-bda1-cf9a942114bd req-ad46f119-cf2d-41b6-8398-b9231c3dcdd1 admin admin] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:41.179671 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-52cd6c9f-cf74-478a-bda1-cf9a942114bd req-ad46f119-cf2d-41b6-8398-b9231c3dcdd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:41.183153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-52cd6c9f-cf74-478a-bda1-cf9a942114bd req-ad46f119-cf2d-41b6-8398-b9231c3dcdd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:41.189500 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-52cd6c9f-cf74-478a-bda1-cf9a942114bd req-ad46f119-cf2d-41b6-8398-b9231c3dcdd1 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:41.189951 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-52cd6c9f-cf74-478a-bda1-cf9a942114bd req-ad46f119-cf2d-41b6-8398-b9231c3dcdd1 admin admin] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:41.204409 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-52cd6c9f-cf74-478a-bda1-cf9a942114bd req-ad46f119-cf2d-41b6-8398-b9231c3dcdd1 admin admin] 10.222.0.64 "DELETE /compute/v2.1/os-assisted-volume-snapshots/68dc7b48-de31-4d2e-a3d9-2f4c64753faf?delete_info=%7B%22file_to_merge%22:%20%22volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.68dc7b48-de31-4d2e-a3d9-2f4c64753faf.vhdx%22,%20%22volume_id%22:%20%220bf6726e-a4a4-44c9-9ec3-f303813a91f7%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.081512 Aug 04 02:45:41.205156 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 457/893] 10.222.0.64 () {62 vars in 1800 bytes} [Thu Aug 4 02:45:41 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/68dc7b48-de31-4d2e-a3d9-2f4c64753faf?delete_info=%7B%22file_to_merge%22:%20%22volume-0bf6726e-a4a4-44c9-9ec3-f303813a91f7.68dc7b48-de31-4d2e-a3d9-2f4c64753faf.vhdx%22,%20%22volume_id%22:%20%220bf6726e-a4a4-44c9-9ec3-f303813a91f7%22%7D => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:45:41.423369 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-255caaf5-c22c-4518-884c-351b6f398b9b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: .version_select at 0x7fa646a243a0>, body: {"keypair": {"name": "tempest-keypair-448931237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPB+jcfOoDiN3aJ7NHdwL/5rMRBZgWDxUHYXQRHKAXwerqkJe9K7FuZdNEZqRk0ZFxGXcJhSQXxEoZRX6MD9Fg8h2L5ZBmRAmKLeMpgkfmaob5fCc9Qn8TUaDSVdpU+1GA=="}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:41.439732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-255caaf5-c22c-4518-884c-351b6f398b9b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:45:41.443571 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-255caaf5-c22c-4518-884c-351b6f398b9b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:45:41.548546 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-255caaf5-c22c-4518-884c-351b6f398b9b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129080 Aug 04 02:45:41.549172 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 437/894] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:45:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:45:43.975961 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2043222273", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "504f11d1-22cf-4971-a6d4-d7b56ff2e4da"}], "security_groups": [{"name": "tempest-securitygroup--1840066735"}], "key_name": "tempest-keypair-448931237", "user_data": "}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:44.079312 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] validate_networks() for [('504f11d1-22cf-4971-a6d4-d7b56ff2e4da', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:45:44.156548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:44.157139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:44.163238 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:44.163706 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:44.164489 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:44.164929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:44.249973 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.objects.instance [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lazy-loading 'services' on Instance uuid 6071196c-4353-45a5-8fb1-bf12a9df7b2b {{(pid=124996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:45:44.400844 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-038ac0c8-ebd7-4c4c-9b93-a35a1512cb2b tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b/os-volume_attachments/0bf6726e-a4a4-44c9-9ec3-f303813a91f7" status: 202 len: 0 microversion: 2.1 time: 0.249487 Aug 04 02:45:44.401488 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 438/895] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:45:44 2022] DELETE /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b/os-volume_attachments/0bf6726e-a4a4-44c9-9ec3-f303813a91f7 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:45:44.458753 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:45:44.459182 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:45:44.459657 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:45:44.460167 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:45:44.460636 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:45:44.470104 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:44.470581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:44.471379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:44.471817 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:44.488302 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:45:44.492244 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:45:44.504196 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:45:44.506664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:45:44.609111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-90d48206-a2e8-41c8-ad8b-6cdb1cfb708b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.638420 Aug 04 02:45:44.609753 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 458/896] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:45:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:45:44.621065 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-30b2201c-8c04-4703-9222-007d0335566d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:44.622411 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-30b2201c-8c04-4703-9222-007d0335566d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:44.675435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-30b2201c-8c04-4703-9222-007d0335566d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:44.682158 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-30b2201c-8c04-4703-9222-007d0335566d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1241 microversion: 2.1 time: 0.065369 Aug 04 02:45:44.682758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 439/897] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:44 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:45.520831 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:45.521412 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:45.529451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:45.529899 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:45.531127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:45.531127 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:45.555948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Going to try to terminate instance {{(pid=124997) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:45:45.704997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:45.705775 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:45.713074 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:45.713528 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:45.714300 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:45.714764 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:45.778067 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:45.785727 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-610b8baa-b636-47e7-a386-b6894f5110ce tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1245 microversion: 2.1 time: 0.085140 Aug 04 02:45:45.786296 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 440/898] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:45 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:45:45.816510 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2c853e1b-09c3-4e44-934c-d2de9a340057 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 204 len: 0 microversion: 2.1 time: 0.299676 Aug 04 02:45:45.817299 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 459/899] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:45:45 2022] DELETE /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:45:45.826156 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:45.826830 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:45.832929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:45.833370 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:45.834163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:45.834625 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:45.964641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:45.972557 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ce087a90-8a6f-4a13-a963-501e942f3127 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1513 microversion: 2.1 time: 0.151008 Aug 04 02:45:45.973462 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 441/900] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:45 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:46.806940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:46.807639 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:46.814182 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:46.814666 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:46.815430 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:46.815866 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:46.879742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:46.887673 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-ac534a4d-97d6-4473-813a-c9e7b73ae0c1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1237 microversion: 2.1 time: 0.084540 Aug 04 02:45:46.888309 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 460/901] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:46 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:46.993038 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:46.993641 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:46.996055 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=4 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:47.000970 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:47.001414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:47.008263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:47.008263 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:47.134338 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:47.142467 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6ed8a88f-c3b3-4d3d-99cc-f444ce4c7e54 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1513 microversion: 2.1 time: 0.153244 Aug 04 02:45:47.143067 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 442/902] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:46 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:47.909332 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:47.909979 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:47.916587 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:47.917036 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:47.917800 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:47.918239 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:47.977592 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:47.984898 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-cd15bf7a-e634-4da9-b50e-ab289ac70343 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1237 microversion: 2.1 time: 0.079441 Aug 04 02:45:47.985463 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 461/903] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:47 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:48.164478 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:48.165053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:48.171929 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:48.172378 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:48.173137 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:48.173573 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:48.301032 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:48.308461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-01931a7d-5366-4f6c-ad75-ba79038bfa81 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1513 microversion: 2.1 time: 0.147960 Aug 04 02:45:48.309028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 443/904] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:48 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:49.006102 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:49.006747 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:49.013654 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:49.014113 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:49.014917 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:49.015360 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:49.075299 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:49.083336 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-58c51367-af31-434e-8b4a-c16b58c0ca23 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1237 microversion: 2.1 time: 0.081210 Aug 04 02:45:49.083962 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 462/905] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:49 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:49.330703 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:49.331323 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:49.337824 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:49.338219 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:49.339014 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:49.339455 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:49.472599 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:49.480024 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-6fe119a4-e77e-40e7-ad65-00b43d75e963 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1513 microversion: 2.1 time: 0.153373 Aug 04 02:45:49.480590 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 444/906] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:49 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:50.256195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:50.256195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:50.256195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:50.256195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:50.257276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:50.257276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:50.257276 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:50.257964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-145b85ef-650c-4dee-9292-e683ef30fbfe tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1237 microversion: 2.1 time: 0.083737 Aug 04 02:45:50.257964 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 463/907] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:50 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:50.500871 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:50.501482 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:50.508034 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:50.508484 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:50.509260 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:50.509697 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:50.722435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:50.729893 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-d9614a45-effb-4244-b582-af92b5ca6eb4 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1513 microversion: 2.1 time: 0.233508 Aug 04 02:45:50.730464 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 445/908] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:50 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:50.977579 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-56136af6-7983-40e2-8889-ae9260d24b49 req-4a8e83ae-b05e-4358-90ab-a947911d0b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6071196c-4353-45a5-8fb1-bf12a9df7b2b", "name": "network-vif-deleted", "tag": "e31a049f-f3da-43e9-ba8d-d27cd6185d53"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:50.987842 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-56136af6-7983-40e2-8889-ae9260d24b49 req-4a8e83ae-b05e-4358-90ab-a947911d0b6d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:50.988289 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-56136af6-7983-40e2-8889-ae9260d24b49 req-4a8e83ae-b05e-4358-90ab-a947911d0b6d service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:51.002029 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-56136af6-7983-40e2-8889-ae9260d24b49 req-4a8e83ae-b05e-4358-90ab-a947911d0b6d service nova] Creating event network-vif-deleted:e31a049f-f3da-43e9-ba8d-d27cd6185d53 for instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b on hv-cinder-74014 Aug 04 02:45:51.007352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-56136af6-7983-40e2-8889-ae9260d24b49 req-4a8e83ae-b05e-4358-90ab-a947911d0b6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033325 Aug 04 02:45:51.010639 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 464/909] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:51.211721 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:51.212327 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:51.219857 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:51.220302 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:51.221067 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:51.221500 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:51.298060 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:51.306618 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-086babb6-0459-4186-9bc1-382b93bb462b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1301 microversion: 2.1 time: 0.098620 Aug 04 02:45:51.307200 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 446/910] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:51 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:51.752185 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:51.752884 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:51.759570 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:51.764111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:51.764111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:51.764111 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:51.794157 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:51.794552 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:51.795009 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lazy-loading 'fault' on Instance uuid 6071196c-4353-45a5-8fb1-bf12a9df7b2b {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:45:51.839940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b027a7cb06b49aa9f5ea95cf0603979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8e5c8f08a44e60aa29e84422acf26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:51.847575 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2c0e271e-28fe-42ed-a8b1-acb474179e04 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 200 len: 1309 microversion: 2.1 time: 0.100420 Aug 04 02:45:51.848143 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 465/911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:51 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:52.328334 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:52.328934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:52.335627 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:52.336079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:52.336843 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:52.337275 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:52.497606 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:52.505031 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-87a3d9c6-2a13-4727-8187-926a9020acfb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1367 microversion: 2.1 time: 0.180779 Aug 04 02:45:52.511059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 447/912] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:52 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:52.869109 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:52.869724 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] [instance: 6071196c-4353-45a5-8fb1-bf12a9df7b2b] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:52.877195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:52.877653 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:52.878418 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:52.878878 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:52.893198 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] HTTP exception thrown: Instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b could not be found. Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Request method failure captured: Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b HTTP/1.1 Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJyMrB_LYwr5_PTUXpgojIabBq1HEsygx1R-Rpm5Wp1YLVlFlwDtuo3i4Em_5SbqJAXlpMFLHQst6cBO_ZcrTb_4agz1TbpdQzqO4H9IeoimcJuptKrOjMWVF2485w8z4xObFtgCUHudTzFMWxsL6hpjnm4bMe3wgguP4HqAAmUtLg Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 4c8e5c8f08a44e60aa29e84422acf26c Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-VolumesSnapshotTestJSON-626900821 Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:45:52.894882 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c8e5c8f08a44e60aa29e84422acf26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-VolumesSnapshotTestJSON-626900821 Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 4c8e5c8f08a44e60aa29e84422acf26c Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-626900821 Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-VolumesSnapshotTestJSON-626900821-project Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 0b027a7cb06b49aa9f5ea95cf0603979 Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-VolumesSnapshotTestJSON-626900821-project Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b could not be found. Aug 04 02:45:52.896659 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '6071196c-4353-45a5-8fb1-bf12a9df7b2b'} Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b could not be found. Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:45:52.897609 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b could not be found. Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b could not be found. Aug 04 02:45:52.899040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:45:52.901153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] Returning 404 to user: Instance 6071196c-4353-45a5-8fb1-bf12a9df7b2b could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:45:52.901153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3ba3541e-465f-45e1-972e-810850da5848 tempest-VolumesSnapshotTestJSON-626900821 tempest-VolumesSnapshotTestJSON-626900821-project] 10.222.0.60 "GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b" status: 404 len: 111 microversion: 2.1 time: 0.031149 Aug 04 02:45:52.901153 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 466/913] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:52 2022] GET /compute/v2.1/servers/6071196c-4353-45a5-8fb1-bf12a9df7b2b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:45:53.033545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-7a5c9756-5fb2-427a-a5ed-e84ad861eb0f req-5aa72474-1f81-4bd6-bb55-2c6d0b7d2099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5047b196-2c17-4715-87e7-e03c5397b19e", "tag": "b9c06b6c-3aeb-4146-a215-015b3e59efba"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:53.043384 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-7a5c9756-5fb2-427a-a5ed-e84ad861eb0f req-5aa72474-1f81-4bd6-bb55-2c6d0b7d2099 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:53.043833 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-7a5c9756-5fb2-427a-a5ed-e84ad861eb0f req-5aa72474-1f81-4bd6-bb55-2c6d0b7d2099 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:53.055828 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-7a5c9756-5fb2-427a-a5ed-e84ad861eb0f req-5aa72474-1f81-4bd6-bb55-2c6d0b7d2099 service nova] Creating event network-changed:b9c06b6c-3aeb-4146-a215-015b3e59efba for instance 5047b196-2c17-4715-87e7-e03c5397b19e on hv-cinder-74014 Aug 04 02:45:53.061418 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-7a5c9756-5fb2-427a-a5ed-e84ad861eb0f req-5aa72474-1f81-4bd6-bb55-2c6d0b7d2099 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032754 Aug 04 02:45:53.062076 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 448/914] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:53.526423 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:53.530845 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:53.533807 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:53.534262 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:53.535194 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:53.535551 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:53.668959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:53.676728 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-8a307c18-c35c-4d4f-bc0c-dcfe115ac998 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1367 microversion: 2.1 time: 0.154553 Aug 04 02:45:53.677291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 467/915] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:53 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:54.699211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:54.700835 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:54.703281 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=6 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:54.718207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:54.718207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:54.718207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:54.718207 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:54.841861 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:54.849578 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9f75a14d-852f-4dbb-a516-945f799031ac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1367 microversion: 2.1 time: 0.154988 Aug 04 02:45:54.850148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 449/916] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:54 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:55.871364 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:55.872022 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:55.874128 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=8 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:55.874820 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=6 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:55.879851 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:55.880414 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:55.881105 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:55.881545 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:56.011417 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:56.019481 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-1dde813c-62ce-4153-93ea-c6c7054e1805 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1367 microversion: 2.1 time: 0.152251 Aug 04 02:45:56.020052 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 468/917] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:55 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:56.631824 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-c4fc0879-184f-4d4d-9c77-96fd5bede194 req-d026ac23-e52d-4427-a462-a5f8acfc2906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047b196-2c17-4715-87e7-e03c5397b19e", "name": "network-vif-plugged", "status": "completed", "tag": "b9c06b6c-3aeb-4146-a215-015b3e59efba"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:45:56.641884 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-c4fc0879-184f-4d4d-9c77-96fd5bede194 req-d026ac23-e52d-4427-a462-a5f8acfc2906 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:56.642329 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-c4fc0879-184f-4d4d-9c77-96fd5bede194 req-d026ac23-e52d-4427-a462-a5f8acfc2906 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:56.653421 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-c4fc0879-184f-4d4d-9c77-96fd5bede194 req-d026ac23-e52d-4427-a462-a5f8acfc2906 service nova] Creating event network-vif-plugged:b9c06b6c-3aeb-4146-a215-015b3e59efba for instance 5047b196-2c17-4715-87e7-e03c5397b19e on hv-cinder-74014 Aug 04 02:45:56.658293 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-c4fc0879-184f-4d4d-9c77-96fd5bede194 req-d026ac23-e52d-4427-a462-a5f8acfc2906 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030270 Aug 04 02:45:56.658915 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 450/918] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:45:57.041379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:57.042046 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:57.049669 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:57.050118 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:57.050918 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:57.051351 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:57.181607 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:57.189266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-043a2daf-f9dc-435e-a6f6-cfcd1ccd87e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1367 microversion: 2.1 time: 0.152172 Aug 04 02:45:57.189837 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 469/919] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:57 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:45:58.211460 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:58.212084 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:58.218903 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:58.219358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:58.220129 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:58.220611 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:58.356368 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:58.363997 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-7461b316-9be5-4d6e-8397-6bfb0b3e6a89 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1367 microversion: 2.1 time: 0.157498 Aug 04 02:45:58.364988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 451/920] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:58 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:59.384350 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:59.386696 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:59.392416 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:59.392858 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:59.393617 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:59.394043 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:59.528234 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:45:59.530717 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:59.546520 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-22db48e4-78f6-4016-9864-5785e020a38a tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1557 microversion: 2.1 time: 0.156632 Aug 04 02:45:59.546520 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 470/921] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:45:59 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:45:59.564933 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-66065e5b-16db-449e-b793-09f0d6bb55db tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:45:59.565435 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-66065e5b-16db-449e-b793-09f0d6bb55db tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:45:59.571921 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66065e5b-16db-449e-b793-09f0d6bb55db tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:59.572371 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66065e5b-16db-449e-b793-09f0d6bb55db tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:59.573141 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66065e5b-16db-449e-b793-09f0d6bb55db tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:45:59.573578 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-66065e5b-16db-449e-b793-09f0d6bb55db tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:45:59.587527 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:59.651459 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-66065e5b-16db-449e-b793-09f0d6bb55db tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090526 Aug 04 02:45:59.652055 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 452/922] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:45:59 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:00.907581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-6ed37c94-b011-4f02-b673-d449fe15da86 req-178ebbdd-50be-4c47-a671-b40e41bd288f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5047b196-2c17-4715-87e7-e03c5397b19e", "tag": "b9c06b6c-3aeb-4146-a215-015b3e59efba"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:46:00.934922 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-6ed37c94-b011-4f02-b673-d449fe15da86 req-178ebbdd-50be-4c47-a671-b40e41bd288f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:00.935647 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-6ed37c94-b011-4f02-b673-d449fe15da86 req-178ebbdd-50be-4c47-a671-b40e41bd288f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:00.954900 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-6ed37c94-b011-4f02-b673-d449fe15da86 req-178ebbdd-50be-4c47-a671-b40e41bd288f service nova] Creating event network-changed:b9c06b6c-3aeb-4146-a215-015b3e59efba for instance 5047b196-2c17-4715-87e7-e03c5397b19e on hv-cinder-74014 Aug 04 02:46:00.960233 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-6ed37c94-b011-4f02-b673-d449fe15da86 req-178ebbdd-50be-4c47-a671-b40e41bd288f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057234 Aug 04 02:46:00.961051 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 471/923] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:36.911085 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:36.915451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-4eb85b09-496f-4d66-b190-d76343e2ac5f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:36.915942 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-4eb85b09-496f-4d66-b190-d76343e2ac5f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:36.922161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4eb85b09-496f-4d66-b190-d76343e2ac5f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:36.926988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4eb85b09-496f-4d66-b190-d76343e2ac5f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:36.926988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4eb85b09-496f-4d66-b190-d76343e2ac5f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:36.926988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-4eb85b09-496f-4d66-b190-d76343e2ac5f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:36.946979 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-4eb85b09-496f-4d66-b190-d76343e2ac5f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/ips" status: 200 len: 149 microversion: 2.1 time: 0.037435 Aug 04 02:46:36.947543 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 453/924] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:46:36 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:38.525640 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0045eb0d-f493-4adc-b525-31109e9a42d6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3a36542-3ac9-45d2-967c-234becd6203e"}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:46:38.528198 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0045eb0d-f493-4adc-b525-31109e9a42d6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:38.530869 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:38.536109 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0045eb0d-f493-4adc-b525-31109e9a42d6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:38.536561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0045eb0d-f493-4adc-b525-31109e9a42d6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:38.537331 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0045eb0d-f493-4adc-b525-31109e9a42d6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:38.537826 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0045eb0d-f493-4adc-b525-31109e9a42d6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:39.427384 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0045eb0d-f493-4adc-b525-31109e9a42d6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906630 Aug 04 02:46:39.428031 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 472/925] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:46:38 2022] POST /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:41.676390 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3a36542-3ac9-45d2-967c-234becd6203e"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:46:41.678760 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:41.685863 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:41.686314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:41.687138 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:41.687581 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:41.825948 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Invalid volume: volume e3a36542-3ac9-45d2-967c-234becd6203e is already attached to instances: 5047b196-2c17-4715-87e7-e03c5397b19e Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: POST /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments HTTP/1.1 Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 74 Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:46:41.827777 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {"volumeAttachment": {"volumeId": "e3a36542-3ac9-45d2-967c-234becd6203e"}} Aug 04 02:46:41.829550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Invalid volume: volume e3a36542-3ac9-45d2-967c-234becd6203e is already attached to instances: 5047b196-2c17-4715-87e7-e03c5397b19e Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'server_id': '5047b196-2c17-4715-87e7-e03c5397b19e', 'body': {'volumeAttachment': {'volumeId': 'e3a36542-3ac9-45d2-967c-234becd6203e'}}} Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e3a36542-3ac9-45d2-967c-234becd6203e is already attached to instances: 5047b196-2c17-4715-87e7-e03c5397b19e Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:41.830563 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e3a36542-3ac9-45d2-967c-234becd6203e is already attached to instances: 5047b196-2c17-4715-87e7-e03c5397b19e Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:46:41.836227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e3a36542-3ac9-45d2-967c-234becd6203e is already attached to instances: 5047b196-2c17-4715-87e7-e03c5397b19e Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 400 to user: Invalid volume: volume e3a36542-3ac9-45d2-967c-234becd6203e is already attached to instances: 5047b196-2c17-4715-87e7-e03c5397b19e {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1f784e4b-56b9-44ac-854f-44cd9c8ce4f9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.158179 Aug 04 02:46:41.837874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 454/926] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:46:41 2022] POST /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 02:46:41.894574 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:41.895151 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:41.901590 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:41.902029 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:41.902814 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:41.903244 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:41.983932 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lazy-loading 'services' on Instance uuid 5047b196-2c17-4715-87e7-e03c5397b19e {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:46:42.199031 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2371c982-e551-4c4e-ade1-f880bdae774c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments/e3a36542-3ac9-45d2-967c-234becd6203e" status: 202 len: 0 microversion: 2.1 time: 0.309583 Aug 04 02:46:42.199620 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 473/927] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:46:41 2022] DELETE /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments/e3a36542-3ac9-45d2-967c-234becd6203e => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:46:42.209168 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1404e132-46cb-4f85-a12f-4806d0a4a0e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:42.211391 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1404e132-46cb-4f85-a12f-4806d0a4a0e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:42.218412 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1404e132-46cb-4f85-a12f-4806d0a4a0e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:42.219536 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1404e132-46cb-4f85-a12f-4806d0a4a0e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:42.220445 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1404e132-46cb-4f85-a12f-4806d0a4a0e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:42.220888 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1404e132-46cb-4f85-a12f-4806d0a4a0e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:42.250778 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1404e132-46cb-4f85-a12f-4806d0a4a0e0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045950 Aug 04 02:46:42.251334 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 455/928] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:46:42 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:43.264284 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-df7be9bc-a15b-4159-9166-36543e88633b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:43.266741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-df7be9bc-a15b-4159-9166-36543e88633b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:43.273071 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df7be9bc-a15b-4159-9166-36543e88633b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:43.273523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df7be9bc-a15b-4159-9166-36543e88633b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:43.274293 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df7be9bc-a15b-4159-9166-36543e88633b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:43.275020 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-df7be9bc-a15b-4159-9166-36543e88633b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:43.304055 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-df7be9bc-a15b-4159-9166-36543e88633b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044600 Aug 04 02:46:43.304540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 474/929] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:46:43 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:46:43.364686 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:43.365171 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:43.371521 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:43.371964 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:43.372741 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:43.373152 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:43.398290 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:46:43.711561 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-e6d222d3-e0f9-4286-a912-28ed9f13a594 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 204 len: 0 microversion: 2.1 time: 0.350349 Aug 04 02:46:43.712154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 456/930] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:46:43 2022] DELETE /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:46:43.720271 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:43.726862 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:43.727265 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:43.727752 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:43.728523 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:43.728963 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:43.858273 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:43.866509 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-055c6cec-a849-4cd7-b813-a6b57dfd3cfa tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1681 microversion: 2.1 time: 0.150147 Aug 04 02:46:43.867085 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 475/931] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:43 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:44.888371 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:44.888988 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:44.895516 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:44.895960 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:44.896721 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:44.897148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:45.029257 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:45.037312 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3a5db3e9-68e4-47e9-a550-c82582bd9c55 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1681 microversion: 2.1 time: 0.153254 Aug 04 02:46:45.037879 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 457/932] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:44 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:46.058650 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:46.059266 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:46.065813 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:46.066263 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:46.067061 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:46.067496 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:46.132443 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:46.140971 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-439fb9ef-4c8d-465e-807c-d36f571c7860 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1613 microversion: 2.1 time: 0.086138 Aug 04 02:46:46.141501 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 476/933] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:46 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:46.389672 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-2410d44d-b645-4e1b-9bd3-6128afa79d08 req-6b046c30-1b68-446c-838b-2cf33215965f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047b196-2c17-4715-87e7-e03c5397b19e", "name": "network-vif-deleted", "tag": "b9c06b6c-3aeb-4146-a215-015b3e59efba"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:46:46.403842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-2410d44d-b645-4e1b-9bd3-6128afa79d08 req-6b046c30-1b68-446c-838b-2cf33215965f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:46.403842 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-2410d44d-b645-4e1b-9bd3-6128afa79d08 req-6b046c30-1b68-446c-838b-2cf33215965f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:46.415158 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-2410d44d-b645-4e1b-9bd3-6128afa79d08 req-6b046c30-1b68-446c-838b-2cf33215965f service nova] Creating event network-vif-deleted:b9c06b6c-3aeb-4146-a215-015b3e59efba for instance 5047b196-2c17-4715-87e7-e03c5397b19e on hv-cinder-74014 Aug 04 02:46:46.420304 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-2410d44d-b645-4e1b-9bd3-6128afa79d08 req-6b046c30-1b68-446c-838b-2cf33215965f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034147 Aug 04 02:46:46.420839 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 458/934] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:47.162697 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:47.163404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:47.170163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:47.170653 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:47.171505 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:47.171949 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:47.207231 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:47.212447 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:47.212447 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lazy-loading 'fault' on Instance uuid 5047b196-2c17-4715-87e7-e03c5397b19e {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:46:47.255650 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:47.264331 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-dea5ee85-2b0e-4b9f-8276-796f0f37488f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 200 len: 1331 microversion: 2.1 time: 0.105719 Aug 04 02:46:47.265048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 477/935] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:47 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:47.314985 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:46:47.315227 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:46:48.287931 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:48.288626 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:48.295543 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:48.295931 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:48.296695 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:48.297166 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:48.311761 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e HTTP/1.1 Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:46:48.313372 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:46:48.315053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '5047b196-2c17-4715-87e7-e03c5397b19e'} Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:46:48.316028 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:46:48.317560 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:46:48.319061 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:46:48.319061 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-20a8f000-cfc9-454c-a8f7-936c341b7f06 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 404 len: 111 microversion: 2.1 time: 0.031133 Aug 04 02:46:48.319061 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 459/936] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:48 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:46:48.323823 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-81fd72fd-04d2-405f-b466-a564567d3eb1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '.version_select at 0x7fa6462df8b0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:48.400327 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-81fd72fd-04d2-405f-b466-a564567d3eb1 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448931237" status: 202 len: 0 microversion: 2.1 time: 0.080284 Aug 04 02:46:48.400900 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 478/937] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 4 02:46:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448931237 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:46:49.354546 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-18cd8c2e-0e6a-40e4-83e3-4ac2eb1de0b8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: .version_select at 0x7fa6468b43a0>, body: {"keypair": {"name": "tempest-keypair-139350785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqhn9RcKETTaYDpJpSxFW6CI7dboc15i+6e5OjoJT5yaspKzWLLzp4GvsWJLrET3aK0HH0ovMrkacF6HEqyJpK1waCdwogyU8Mg6/XpxyHN9tNYzVLKmhUCjsXOnKMQ9g=="}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:46:49.370509 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-18cd8c2e-0e6a-40e4-83e3-4ac2eb1de0b8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:46:49.374503 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.quota [None req-18cd8c2e-0e6a-40e4-83e3-4ac2eb1de0b8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'key_pairs'} {{(pid=124996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:46:49.463562 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-18cd8c2e-0e6a-40e4-83e3-4ac2eb1de0b8 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112944 Aug 04 02:46:49.464160 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 460/938] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 4 02:46:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:51.619404 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-988535248", "imageRef": "bdd09ff5-6519-4003-a010-2e373cfa1704", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "504f11d1-22cf-4971-a6d4-d7b56ff2e4da"}], "security_groups": [{"name": "tempest-securitygroup--800360881"}], "key_name": "tempest-keypair-139350785", "user_data": "}} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:46:51.724280 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.network.neutron [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] validate_networks() for [('504f11d1-22cf-4971-a6d4-d7b56ff2e4da', None, None, None, None, None)] {{(pid=124997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:46:52.089991 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:46:52.090431 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image limits 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:46:52.091010 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Flavor pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:46:52.091407 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Image pref 0:0:0 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:46:52.091824 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.virt.hardware [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:46:52.101908 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:52.102397 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:52.103236 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:52.103675 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:52.121069 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:46:52.125047 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.quota [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Getting quotas for user 3a20282bb5cf4561b60cab04acd0cab4 and project 64ca976f81ab4112b9fe4f24760862b9. Resources: {'instances', 'ram', 'cores'} {{(pid=124997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:46:52.136335 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Going to run 1 instances... {{(pid=124997) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:46:52.138650 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdd09ff5-6519-4003-a010-2e373cfa1704',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:46:52.304415 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0c390be6-4153-4ba5-b2fc-89bb498a8a58 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.690438 Aug 04 02:46:52.305059 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 479/939] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 4 02:46:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:46:52.316090 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-608a878e-e665-46b0-8da7-fb19cf19ebcc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:52.316699 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-608a878e-e665-46b0-8da7-fb19cf19ebcc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:52.376766 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-608a878e-e665-46b0-8da7-fb19cf19ebcc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:52.383520 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-608a878e-e665-46b0-8da7-fb19cf19ebcc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1240 microversion: 2.1 time: 0.071438 Aug 04 02:46:52.384087 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 461/940] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:52 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:53.406040 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:53.406683 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:53.412948 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:53.413398 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:53.414179 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:53.414642 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:53.479646 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:53.485841 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-0806dc66-2385-47b3-8369-dc4e1effe0b6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1236 microversion: 2.1 time: 0.083584 Aug 04 02:46:53.486469 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 480/941] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:53 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:54.509949 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:54.510580 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:54.519428 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:54.519428 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:54.519428 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:54.519428 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:54.588919 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:54.597339 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-df792674-21f9-44ab-8c43-8cb0243759fc tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1298 microversion: 2.1 time: 0.091205 Aug 04 02:46:54.597910 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 462/942] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:54 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:55.618563 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:55.619285 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:55.626677 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:55.627207 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:55.628052 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:55.628561 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:55.761407 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:55.769031 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-86f4a83b-4808-4663-913b-5c1915cf092b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1365 microversion: 2.1 time: 0.154616 Aug 04 02:46:55.769615 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 481/943] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:55 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:55.869726 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-14cbd685-522a-4093-b85b-7b1e90dced8a req-e5ea585e-689f-4d8a-ad7f-95807b4b510c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d3312b-6a39-4a6b-a90e-0cfbbed63cbf", "tag": "c0c231da-4068-49e4-a579-25d7be0ea4dc"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:46:55.880875 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-14cbd685-522a-4093-b85b-7b1e90dced8a req-e5ea585e-689f-4d8a-ad7f-95807b4b510c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:55.881314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-14cbd685-522a-4093-b85b-7b1e90dced8a req-e5ea585e-689f-4d8a-ad7f-95807b4b510c service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:55.893374 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-14cbd685-522a-4093-b85b-7b1e90dced8a req-e5ea585e-689f-4d8a-ad7f-95807b4b510c service nova] Creating event network-changed:c0c231da-4068-49e4-a579-25d7be0ea4dc for instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf on hv-cinder-74014 Aug 04 02:46:55.898314 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-14cbd685-522a-4093-b85b-7b1e90dced8a req-e5ea585e-689f-4d8a-ad7f-95807b4b510c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Aug 04 02:46:55.898987 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 463/944] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:46:56.790715 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:56.791291 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:56.797761 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:56.798742 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:56.799619 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:56.800059 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:56.926107 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:56.933525 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-dd99e716-a8cc-45e0-98ed-289595b69747 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1365 microversion: 2.1 time: 0.146856 Aug 04 02:46:56.934101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 482/945] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:56 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:57.955800 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:57.956507 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:57.962921 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:57.963374 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:57.964140 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:57.964581 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:58.097359 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:58.104740 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f9e435bf-28e2-47f8-b879-336ece564ea0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1365 microversion: 2.1 time: 0.153737 Aug 04 02:46:58.105311 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 464/946] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:57 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:46:59.125649 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:46:59.126315 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:46:59.132829 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:59.133287 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:59.134054 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:46:59.134524 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:46:59.268030 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:46:59.275863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2a71efc5-e3a9-4be8-b0f2-6cc5011804eb tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1365 microversion: 2.1 time: 0.154088 Aug 04 02:46:59.276435 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 483/947] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:46:59 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:00.297548 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:00.298747 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:00.305250 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:00.305703 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:00.306471 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:00.306936 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:00.434624 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:00.442116 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-5c1f62a7-a8cc-450a-88af-65440531f305 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1365 microversion: 2.1 time: 0.148563 Aug 04 02:47:00.442737 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 465/948] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:00 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:01.141379 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [req-0d53a036-81e4-4457-bcf1-01709b901208 req-b524bc1e-bf13-48a1-9212-0fbaa597fe53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d3312b-6a39-4a6b-a90e-0cfbbed63cbf", "name": "network-vif-plugged", "status": "completed", "tag": "c0c231da-4068-49e4-a579-25d7be0ea4dc"}]} {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:47:01.152347 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0d53a036-81e4-4457-bcf1-01709b901208 req-b524bc1e-bf13-48a1-9212-0fbaa597fe53 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:01.152791 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [req-0d53a036-81e4-4457-bcf1-01709b901208 req-b524bc1e-bf13-48a1-9212-0fbaa597fe53 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:01.163660 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.compute.server_external_events [req-0d53a036-81e4-4457-bcf1-01709b901208 req-b524bc1e-bf13-48a1-9212-0fbaa597fe53 service nova] Creating event network-vif-plugged:c0c231da-4068-49e4-a579-25d7be0ea4dc for instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf on hv-cinder-74014 Aug 04 02:47:01.168602 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [req-0d53a036-81e4-4457-bcf1-01709b901208 req-b524bc1e-bf13-48a1-9212-0fbaa597fe53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Aug 04 02:47:01.169268 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 484/949] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:47:01.463628 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:01.464365 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:01.471599 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:01.472705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:01.473497 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:01.473948 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:01.608358 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:01.616486 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-507fa82e-3210-4133-be22-b36a6d1cce2f tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1365 microversion: 2.1 time: 0.156887 Aug 04 02:47:01.617058 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 466/950] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:01 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:02.635700 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:02.636465 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell0:SELECT=6 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:02.640910 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:02.641613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:02.649328 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:02.653511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:02.653511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:02.653511 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:02.788337 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:02.795776 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5117e6b9-354b-4fac-a016-c014e2ad2da3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1365 microversion: 2.1 time: 0.161063 Aug 04 02:47:02.796340 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 485/951] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:02 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:03.817545 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:03.818079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:03.820026 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell0:SELECT=6 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:03.825291 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:03.831451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:03.831451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:03.831451 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:03.957374 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:03.964694 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-c7bc8017-d413-42e0-901e-0ee2ac14c989 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1555 microversion: 2.1 time: 0.151683 Aug 04 02:47:03.965260 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 467/952] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:03 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:03.984946 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3ea8b68f-c8ad-48b6-b810-bfae4799f98b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:03.985451 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3ea8b68f-c8ad-48b6-b810-bfae4799f98b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:03.991940 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ea8b68f-c8ad-48b6-b810-bfae4799f98b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:03.992388 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ea8b68f-c8ad-48b6-b810-bfae4799f98b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:03.993145 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ea8b68f-c8ad-48b6-b810-bfae4799f98b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:03.993581 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3ea8b68f-c8ad-48b6-b810-bfae4799f98b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:04.072593 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3ea8b68f-c8ad-48b6-b810-bfae4799f98b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091566 Aug 04 02:47:04.073186 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 486/953] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 4 02:47:03 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:47:05.310732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-022e3d9d-fdec-465d-902d-029209dcbd1d req-761160fe-f977-4ebc-bb6e-1a41fd3432f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d3312b-6a39-4a6b-a90e-0cfbbed63cbf", "tag": "c0c231da-4068-49e4-a579-25d7be0ea4dc"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:47:05.321665 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-022e3d9d-fdec-465d-902d-029209dcbd1d req-761160fe-f977-4ebc-bb6e-1a41fd3432f4 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:05.322732 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-022e3d9d-fdec-465d-902d-029209dcbd1d req-761160fe-f977-4ebc-bb6e-1a41fd3432f4 service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:05.333284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-022e3d9d-fdec-465d-902d-029209dcbd1d req-761160fe-f977-4ebc-bb6e-1a41fd3432f4 service nova] Creating event network-changed:c0c231da-4068-49e4-a579-25d7be0ea4dc for instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf on hv-cinder-74014 Aug 04 02:47:05.338154 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-022e3d9d-fdec-465d-902d-029209dcbd1d req-761160fe-f977-4ebc-bb6e-1a41fd3432f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031238 Aug 04 02:47:05.338770 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 468/954] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:47:41.301048 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:41.301859 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:41.305779 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-db58cecc-3e0c-465d-baf5-a04f7931271d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:41.306272 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-db58cecc-3e0c-465d-baf5-a04f7931271d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:41.312197 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db58cecc-3e0c-465d-baf5-a04f7931271d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:41.314702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db58cecc-3e0c-465d-baf5-a04f7931271d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:41.314702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db58cecc-3e0c-465d-baf5-a04f7931271d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:41.314702 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-db58cecc-3e0c-465d-baf5-a04f7931271d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:41.338989 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-db58cecc-3e0c-465d-baf5-a04f7931271d tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/ips" status: 200 len: 149 microversion: 2.1 time: 0.039401 Aug 04 02:47:41.343401 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 487/955] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 4 02:47:41 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:47:42.983895 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:42.985027 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:42.989450 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-3e6cff61-7c47-44cf-a1e5-5d4c019b7606 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "603208d0-b3a7-4454-aa12-035f2065c6a3"}} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:47:42.992658 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-3e6cff61-7c47-44cf-a1e5-5d4c019b7606 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:42.998721 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e6cff61-7c47-44cf-a1e5-5d4c019b7606 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:42.999153 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e6cff61-7c47-44cf-a1e5-5d4c019b7606 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:43.000218 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e6cff61-7c47-44cf-a1e5-5d4c019b7606 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:43.000322 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-3e6cff61-7c47-44cf-a1e5-5d4c019b7606 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:43.722148 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-3e6cff61-7c47-44cf-a1e5-5d4c019b7606 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "POST /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739719 Aug 04 02:47:43.722791 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 469/956] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 4 02:47:42 2022] POST /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments => generated 194 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:47:46.056699 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:46.057169 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:46.064329 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:46.068756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:46.068756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:46.068756 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:46.144820 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lazy-loading 'services' on Instance uuid 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:47:46.392254 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9c44c307-065e-4d76-8858-942c06392e79 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments/603208d0-b3a7-4454-aa12-035f2065c6a3" status: 202 len: 0 microversion: 2.1 time: 0.340672 Aug 04 02:47:46.401918 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 488/957] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 4 02:47:46 2022] DELETE /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments/603208d0-b3a7-4454-aa12-035f2065c6a3 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:47:46.403605 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2aee4497-a847-4650-b3b9-db0157b94d1b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:46.406075 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2aee4497-a847-4650-b3b9-db0157b94d1b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:46.412919 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2aee4497-a847-4650-b3b9-db0157b94d1b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:46.413416 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2aee4497-a847-4650-b3b9-db0157b94d1b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:46.414864 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2aee4497-a847-4650-b3b9-db0157b94d1b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:46.415284 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2aee4497-a847-4650-b3b9-db0157b94d1b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:46.444502 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2aee4497-a847-4650-b3b9-db0157b94d1b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Aug 04 02:47:46.445059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 470/958] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:47:46 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:47:47.457222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9b1ff9a5-2da3-4e93-97af-933105528cf6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:47.459663 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9b1ff9a5-2da3-4e93-97af-933105528cf6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:47.466230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b1ff9a5-2da3-4e93-97af-933105528cf6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:47.466728 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b1ff9a5-2da3-4e93-97af-933105528cf6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:47.467504 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b1ff9a5-2da3-4e93-97af-933105528cf6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:47.467945 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9b1ff9a5-2da3-4e93-97af-933105528cf6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:47.497907 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9b1ff9a5-2da3-4e93-97af-933105528cf6 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045523 Aug 04 02:47:47.498457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 489/959] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 4 02:47:47 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:47:47.559557 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:47.560079 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:47.566445 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:47.566944 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:47.567692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:47.568128 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:47.592892 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Going to try to terminate instance {{(pid=124996) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:47:47.887379 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-9be386cc-0b52-4830-a948-be4d4477bbe0 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 204 len: 0 microversion: 2.1 time: 0.331389 Aug 04 02:47:47.887961 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 471/960] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:47:47 2022] DELETE /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:47:47.896230 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:47.896855 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:47.903944 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:47.904399 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:47.905173 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:47.905613 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:48.036144 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:48.044457 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-43dcb898-8d25-4abf-966f-4e3cd731b3b3 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1679 microversion: 2.1 time: 0.152096 Aug 04 02:47:48.047138 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 490/961] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:47 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:49.067325 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:49.068034 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:49.075059 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:49.075510 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:49.076280 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:49.076724 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:49.205858 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.policy [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124996) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:49.213622 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-639c156b-9f4d-4656-ba5a-3ecfa03b9173 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1679 microversion: 2.1 time: 0.150548 Aug 04 02:47:49.214195 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 472/962] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:49 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:50.235164 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:50.235757 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:50.242107 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:50.247462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:50.247462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:50.247462 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:50.385255 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:50.391656 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a3639a7d-6831-4fdc-875d-15f1cc1a8d62 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1679 microversion: 2.1 time: 0.160278 Aug 04 02:47:50.392242 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 491/963] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:50 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:50.704809 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [req-a4618ba2-92c4-49b7-af2a-9e19e370ac0a req-33339abd-c0d0-45f9-86ed-6ab31a7d633f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d3312b-6a39-4a6b-a90e-0cfbbed63cbf", "name": "network-vif-deleted", "tag": "c0c231da-4068-49e4-a579-25d7be0ea4dc"}]} {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:47:50.714811 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-a4618ba2-92c4-49b7-af2a-9e19e370ac0a req-33339abd-c0d0-45f9-86ed-6ab31a7d633f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:50.716429 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [req-a4618ba2-92c4-49b7-af2a-9e19e370ac0a req-33339abd-c0d0-45f9-86ed-6ab31a7d633f service nova] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:50.728667 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.compute.server_external_events [req-a4618ba2-92c4-49b7-af2a-9e19e370ac0a req-33339abd-c0d0-45f9-86ed-6ab31a7d633f service nova] Creating event network-vif-deleted:c0c231da-4068-49e4-a579-25d7be0ea4dc for instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf on hv-cinder-74014 Aug 04 02:47:50.735891 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [req-a4618ba2-92c4-49b7-af2a-9e19e370ac0a req-33339abd-c0d0-45f9-86ed-6ab31a7d633f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095741 Aug 04 02:47:50.736474 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 473/964] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 4 02:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:47:51.413921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:51.414643 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:51.421624 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:51.422354 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:51.423163 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:51.423650 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:51.459195 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:51.459909 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:51.460527 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.objects.instance [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lazy-loading 'fault' on Instance uuid 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf {{(pid=124997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:47:51.503330 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.policy [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20282bb5cf4561b60cab04acd0cab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ca976f81ab4112b9fe4f24760862b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124997) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:47:51.511622 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-da470e98-16d0-4872-b5f4-36a555c9dbac tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 200 len: 1330 microversion: 2.1 time: 0.101862 Aug 04 02:47:51.512417 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 492/965] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:51 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:47:52.533793 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:52.534506 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:52.540858 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:52.541310 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:52.542078 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:52.542550 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:52.557722 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf HTTP/1.1 Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:47:52.559356 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:52.561105 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '49d3312b-6a39-4a6b-a90e-0cfbbed63cbf'} Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:52.562036 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:52.563688 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:52.565097 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:52.565097 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-1998e8a8-5a8e-40e8-8bb5-f96e8fb0a37c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 404 len: 111 microversion: 2.1 time: 0.031645 Aug 04 02:47:52.565097 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 474/966] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:52 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:47:52.569595 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-648d27e1-9c98-4223-a0f4-68579e37b97c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '.version_select at 0x7fa646333a60>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:52.636433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-648d27e1-9c98-4223-a0f4-68579e37b97c tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139350785" status: 202 len: 0 microversion: 2.1 time: 0.070571 Aug 04 02:47:52.637029 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 493/967] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 4 02:47:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139350785 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:47:54.650107 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:54.650617 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:54.657135 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:54.657605 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:54.658355 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:54.658824 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:54.672010 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf HTTP/1.1 Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:47:54.673526 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.675187 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '49d3312b-6a39-4a6b-a90e-0cfbbed63cbf'} Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:54.676151 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.677417 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.678700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:54.678700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ad24ecb8-adf2-4489-90fa-5143db9d54ef tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 404 len: 111 microversion: 2.1 time: 0.028991 Aug 04 02:47:54.678700 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 475/968] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:47:54 2022] DELETE /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:47:54.684572 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:54.685241 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:54.692433 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:54.692888 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:54.700492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:54.700492 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:54.707973 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf HTTP/1.1 Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:47:54.709731 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.711339 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '49d3312b-6a39-4a6b-a90e-0cfbbed63cbf'} Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:54.712352 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. Aug 04 02:47:54.714008 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:54.715391 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 49d3312b-6a39-4a6b-a90e-0cfbbed63cbf could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:54.715391 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-3bd994e7-251b-477f-914f-328b0817aec9 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf" status: 404 len: 111 microversion: 2.1 time: 0.031847 Aug 04 02:47:54.715391 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 494/969] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:54 2022] GET /compute/v2.1/servers/49d3312b-6a39-4a6b-a90e-0cfbbed63cbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:47:56.003158 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:56.003656 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:56.010819 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.011273 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.012030 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.012465 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.025745 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e HTTP/1.1 Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:47:56.027306 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.028934 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '5047b196-2c17-4715-87e7-e03c5397b19e'} Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:56.029758 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.031139 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.032584 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:56.032584 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-b536ff5f-2f18-45d0-96bf-84c82d4a0e38 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 404 len: 111 microversion: 2.1 time: 0.029333 Aug 04 02:47:56.032584 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 476/970] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:47:55 2022] DELETE /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:47:56.037205 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:56.037821 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 5047b196-2c17-4715-87e7-e03c5397b19e] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:56.044564 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.045011 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.045772 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.046206 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.061600 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e HTTP/1.1 Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:47:56.063165 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.064763 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '5047b196-2c17-4715-87e7-e03c5397b19e'} Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:56.065568 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. Aug 04 02:47:56.066822 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.067965 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 5047b196-2c17-4715-87e7-e03c5397b19e could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:56.067965 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-145fd296-0d43-4705-92d5-fa498baa5a53 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e" status: 404 len: 111 microversion: 2.1 time: 0.031157 Aug 04 02:47:56.067965 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 495/971] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:56 2022] GET /compute/v2.1/servers/5047b196-2c17-4715-87e7-e03c5397b19e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:47:56.073857 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:56.074355 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:56.080431 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.080874 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.081632 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.082069 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.095448 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf HTTP/1.1 Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:47:56.096965 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.098705 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '218d0afe-849b-4a0f-96e4-caf2afd7c4bf'} Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:56.099539 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.100784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.102127 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:56.102127 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-2b4911bf-9cae-4217-81c1-fc656e8aab5b tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 404 len: 111 microversion: 2.1 time: 0.029013 Aug 04 02:47:56.102127 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 477/972] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:47:56 2022] DELETE /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:47:56.107399 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:56.108119 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 218d0afe-849b-4a0f-96e4-caf2afd7c4bf] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:56.113998 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.114441 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.115221 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:56.115653 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:56.129410 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf HTTP/1.1 Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:47:56.130947 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.133101 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '218d0afe-849b-4a0f-96e4-caf2afd7c4bf'} Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:56.133941 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. Aug 04 02:47:56.135222 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:56.136377 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 218d0afe-849b-4a0f-96e4-caf2afd7c4bf could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:56.136377 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9825adb3-092f-405f-8859-6408e4057721 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf" status: 404 len: 111 microversion: 2.1 time: 0.028697 Aug 04 02:47:56.136377 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 496/973] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:56 2022] GET /compute/v2.1/servers/218d0afe-849b-4a0f-96e4-caf2afd7c4bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:47:57.395683 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:57.396184 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.compute.api [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124996) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:57.403132 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:57.403581 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:57.404345 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:57.404786 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG oslo_concurrency.lockutils [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:57.418295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.wsgi [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: request: DELETE /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 HTTP/1.1 Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept: application/json Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Accept-Encoding: identity Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Connection: close Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Length: 0 Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Content-Type: application/json Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Host: 10.222.0.60 Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Openstack-System-Scope: None Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Id: None Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Domain-Name: None Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Identity-Status: Confirmed Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Is-Admin-Project: True Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Id: default Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Domain-Name: Default Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Role: reader,member Aug 04 02:47:57.421180 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Roles: reader,member Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Id: default Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Domain-Name: Default Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: method: > Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: exception: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.422917 dv-cinder-740146-17-smb devstack@n-api.service[124996]: action_args: {'id': '10b7e802-d8bf-452b-82be-12efdc250b46'} Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:57.423862 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.425461 dv-cinder-740146-17-smb devstack@n-api.service[124996]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.427029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. {{(pid=124996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:57.427029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-47fdeb4c-6f0b-480f-ad33-8629d8deedaf tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "DELETE /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 404 len: 111 microversion: 2.1 time: 0.029506 Aug 04 02:47:57.427029 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 478/974] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 4 02:47:57 2022] DELETE /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:47:57.430789 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Calling method '>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:47:57.431399 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.compute.api [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] [instance: 10b7e802-d8bf-452b-82be-12efdc250b46] Fetching instance by UUID {{(pid=124997) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:47:57.437562 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:57.438005 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:57.438876 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:47:57.439311 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG oslo_concurrency.lockutils [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Lock "3d67d506-3efa-49a4-9082-a0012026440f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:47:57.453706 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.wsgi [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] HTTP exception thrown: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Request method failure captured: Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: request: GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 HTTP/1.1 Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept: application/json Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Accept-Encoding: identity Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Connection: close Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Length: 0 Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Content-Type: application/json Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Host: 10.222.0.60 Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Openstack-System-Scope: None Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: User-Agent: python-urllib3/1.26.11 Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Auth-Token: gAAAAABi6zJZAyMikyHZicFU48NYt_sQGcekmvqkN1hfZq9PbcL025Im9hy5QvjS051_IWdYViviDywJdMZ5CW1qHPZym56U4VMpostaQzRM26TVWjT7m72pSC2WSIPkRGwNzDvX75dow9-tD0nrfkyzS8382nnm7P3kAk5j2d5IkQOkPlB9BbI Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Id: None Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Domain-Name: None Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Identity-Status: Confirmed Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Is-Admin-Project: True Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Id: default Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Domain-Name: Default Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Role: reader,member Aug 04 02:47:57.455278 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Roles: reader,member Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/64ca976f81ab4112b9fe4f24760862b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Id: 64ca976f81ab4112b9fe4f24760862b9 Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103635815 Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Id: default Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Domain-Name: Default Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Id: 3a20282bb5cf4561b60cab04acd0cab4 Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: X-User-Name: tempest-AttachVolumeNegativeTest-2103635815-project Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: method: > Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: exception: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.456953 dv-cinder-740146-17-smb devstack@n-api.service[124997]: action_args: {'id': '10b7e802-d8bf-452b-82be-12efdc250b46'} Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:47:57.457849 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. Aug 04 02:47:57.459380 dv-cinder-740146-17-smb devstack@n-api.service[124997]: ERROR nova.api.openstack.wsgi Aug 04 02:47:57.460867 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] Returning 404 to user: Instance 10b7e802-d8bf-452b-82be-12efdc250b46 could not be found. {{(pid=124997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:47:57.460867 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-641afc33-71e8-4fdf-8628-c72f095c8974 tempest-AttachVolumeNegativeTest-2103635815 tempest-AttachVolumeNegativeTest-2103635815-project] 10.222.0.60 "GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46" status: 404 len: 111 microversion: 2.1 time: 0.030355 Aug 04 02:47:57.460867 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 497/975] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 4 02:47:57 2022] GET /compute/v2.1/servers/10b7e802-d8bf-452b-82be-12efdc250b46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:48:04.577620 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-72c24b36-7e47-4959-afd8-8bef1cffe737 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa6468b4af0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:04.624738 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-72c24b36-7e47-4959-afd8-8bef1cffe737 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0d265842-16cf-493e-8865-21b7bf10c73a" status: 200 len: 351 microversion: 2.1 time: 0.050886 Aug 04 02:48:04.625340 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 479/976] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:48:04 2022] GET /compute/v2.1/os-volumes/0d265842-16cf-493e-8865-21b7bf10c73a => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:48:06.211992 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-5d85bf62-1628-456f-93d4-857ff9119fba tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa647f71e50>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:06.259877 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-5d85bf62-1628-456f-93d4-857ff9119fba tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b9880159-31ee-4886-bc4a-496e54330a1a" status: 200 len: 351 microversion: 2.1 time: 0.051869 Aug 04 02:48:06.260540 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 498/977] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:48:06 2022] GET /compute/v2.1/os-volumes/b9880159-31ee-4886-bc4a-496e54330a1a => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:48:07.981905 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:07.982692 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG dbcounter [-] [124996] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:07.986444 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ac6b3b34-7c04-4ba8-a950-3dddd6900c84 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa6469c4ca0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.034846 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ac6b3b34-7c04-4ba8-a950-3dddd6900c84 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8f45fd36-c878-4aa0-ba37-71d1eda4568e" status: 200 len: 351 microversion: 2.1 time: 0.054197 Aug 04 02:48:08.035414 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 480/978] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 4 02:48:07 2022] GET /compute/v2.1/os-volumes/8f45fd36-c878-4aa0-ba37-71d1eda4568e => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:48:08.045934 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:08.046784 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG dbcounter [-] [124997] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:08.050703 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-a0711471-51d7-444e-aab7-62160c8f733a tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa6460a2280>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.134986 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-a0711471-51d7-444e-aab7-62160c8f733a tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.090256 Aug 04 02:48:08.135558 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 499/979] 10.222.0.60 () {58 vars in 1134 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:48:08.149211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-233866c6-6854-4386-a54f-c5b90bc12aed tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa6468b4310>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.232814 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-233866c6-6854-4386-a54f-c5b90bc12aed tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087628 Aug 04 02:48:08.233382 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 481/980] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:48:08.248092 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-2054f1f1-ce4b-410f-844f-34f6711436c2 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa64603faf0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.330637 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-2054f1f1-ce4b-410f-844f-34f6711436c2 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087099 Aug 04 02:48:08.331212 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 500/981] 10.222.0.60 () {58 vars in 1134 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:48:08.343784 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-f4fa4a21-7983-4f13-a010-1db3384ab574 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa646a04dc0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.426161 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-f4fa4a21-7983-4f13-a010-1db3384ab574 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086025 Aug 04 02:48:08.426781 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 482/982] 10.222.0.60 () {58 vars in 1167 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:48:08.440226 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-faeaab22-b4ee-40cd-b1e3-2654037add43 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa6461ff3a0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.521166 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-faeaab22-b4ee-40cd-b1e3-2654037add43 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084647 Aug 04 02:48:08.521741 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 501/983] 10.222.0.60 () {58 vars in 1170 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:48:08.535053 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-ec053175-4b88-4f5b-baf1-81ab3ff48fac tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa646a0ea60>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.616211 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-ec053175-4b88-4f5b-baf1-81ab3ff48fac tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084824 Aug 04 02:48:08.616774 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 483/984] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:48:08.629757 dv-cinder-740146-17-smb devstack@n-api.service[124997]: DEBUG nova.api.openstack.wsgi [None req-9107e69e-f0dc-46ce-9c98-b62b8e77d94a tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa6463335e0>' {{(pid=124997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.714313 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO nova.api.openstack.requestlog [None req-9107e69e-f0dc-46ce-9c98-b62b8e77d94a tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088259 Aug 04 02:48:08.714957 dv-cinder-740146-17-smb devstack@n-api.service[124997]: [pid: 124997|app: 0|req: 502/985] 10.222.0.60 () {58 vars in 1188 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:48:08.728215 dv-cinder-740146-17-smb devstack@n-api.service[124996]: DEBUG nova.api.openstack.wsgi [None req-da1fb48d-79d4-473e-bf3f-a7b249f0aa65 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] Calling method '.version_select at 0x7fa6469b7ee0>' {{(pid=124996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:48:08.808597 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO nova.api.openstack.requestlog [None req-da1fb48d-79d4-473e-bf3f-a7b249f0aa65 tempest-VolumesTestJSON-2088205483 tempest-VolumesTestJSON-2088205483-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084710 Aug 04 02:48:08.809163 dv-cinder-740146-17-smb devstack@n-api.service[124996]: [pid: 124996|app: 0|req: 484/986] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 4 02:48:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:49:01.870733 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:49:01.871482 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:49:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:50:07.323496 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:50:07.324116 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:50:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:50:23.762432 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:50:23.764003 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Thu Aug 4 02:50:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:50:27.127970 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:50:27.128425 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:52:02.149425 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:52:02.149959 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Thu Aug 4 02:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:52:21.878993 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:52:21.879504 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:53:27.331481 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:53:27.332175 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:53:28.546863 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:53:28.547426 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Thu Aug 4 02:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:53:43.770921 dv-cinder-740146-17-smb devstack@n-api.service[124997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:53:43.771664 dv-cinder-740146-17-smb devstack@n-api.service[124997]: Thu Aug 4 02:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:53:47.136295 dv-cinder-740146-17-smb devstack@n-api.service[124996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:53:47.136830 dv-cinder-740146-17-smb devstack@n-api.service[124996]: Thu Aug 4 02:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!